-- Logs begin at Tue 2022-08-02 08:06:50 UTC, end at Tue 2022-08-02 09:20:22 UTC. -- Aug 02 08:44:34.069691 dv-cinder-787296-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 08:44:34.080269 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 08:44:34 2022] *** Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: nodename: dv-cinder-787296-14-iscsi Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: machine: x86_64 Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: clock source: unix Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: pcre jit disabled Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: detected number of CPU cores: 4 Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: current working directory: / Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: detected binary path: /usr/bin/uwsgi-core Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: your processes number limit is 47680 Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: your memory page size is 4096 bytes Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: detected max file descriptor number: 2048 Aug 02 08:44:34.082255 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: lock engine: pthread robust mutexes Aug 02 08:44:34.083422 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: thunder lock: enabled Aug 02 08:44:34.083422 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 08:44:34.083422 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 08:44:34.121874 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: Python main interpreter initialized at 0x558177cc29c0 Aug 02 08:44:34.121874 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: python threads support enabled Aug 02 08:44:34.121874 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: your server socket listen backlog is limited to 100 connections Aug 02 08:44:34.121874 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: your mercy for graceful operations on workers is 90 seconds Aug 02 08:44:34.122423 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 08:44:34.122423 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: *** Operational MODE: preforking *** Aug 02 08:44:34.125678 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: *** uWSGI is running in multiple interpreter mode *** Aug 02 08:44:34.125678 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: spawned uWSGI master process (pid: 103203) Aug 02 08:44:34.125678 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: spawned uWSGI worker 1 (pid: 103204, cores: 1) Aug 02 08:44:34.125678 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: spawned uWSGI worker 2 (pid: 103205, cores: 1) Aug 02 08:44:34.125678 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 08:44:34.122778 dv-cinder-787296-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 08:44:34.786075 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 08:44:34.807345 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 08:44:35.873335 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:44:35.873335 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: from cryptography.utils import int_from_bytes Aug 02 08:44:35.873889 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:44:35.873889 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: from cryptography.utils import int_from_bytes Aug 02 08:44:35.882183 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:44:35.882183 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: from cryptography.utils import int_from_bytes Aug 02 08:44:35.882604 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:44:35.882604 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: from cryptography.utils import int_from_bytes Aug 02 08:44:38.386169 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:44:38.386856 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:44:38.386962 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:44:38.387305 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:44:38.387385 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:44:38.387460 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:44:38.387536 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:44:38.387608 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:44:38.387868 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.387977 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:44:38.388154 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:44:38.388262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.388516 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.388625 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.388831 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.388923 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.389160 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.389247 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.389462 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.389565 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.389778 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.389873 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.390084 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.390179 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.390401 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.390489 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.390659 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.390749 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.390970 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.391079 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.391277 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.391364 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-14-iscsi {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.391589 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.391675 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.391889 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.391987 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-14-iscsi {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.392229 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.392321 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.392537 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.392636 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.392832 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.392930 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.393148 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.393236 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.393448 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.393535 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.393769 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.393931 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.394357 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.394985 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.395195 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.395348 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.395506 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.395624 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.395818 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.395958 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.396140 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.396255 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.396471 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.396559 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.396797 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.396893 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.397082 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.397179 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.397399 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.397500 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.397698 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.397794 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.398016 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.398104 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-14-iscsi {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.398327 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.398416 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.398675 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.398769 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-14-iscsi {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.398983 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.399067 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.399318 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.399465 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.399632 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.399860 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.399959 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.400047 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.400303 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.400432 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.400608 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.400700 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.400911 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.401002 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.401231 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.401327 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.401546 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.401638 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.401858 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.401948 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.402171 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.402260 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.402469 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.402568 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.402769 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.402858 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.403071 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.403168 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.403374 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.403519 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.403671 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.403759 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.403971 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.404060 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.404244 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.404356 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.404547 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.404645 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.404834 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.404939 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.405145 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.405259 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.405466 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.405569 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.405713 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.405804 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.405961 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.406087 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.406278 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.406395 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.406579 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.406682 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.406892 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.406994 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.407180 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.407277 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.407481 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.407579 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.407783 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.407872 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.408084 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.408205 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.408408 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.408510 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.408710 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.408806 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.409011 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.409107 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.409316 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.409404 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.409625 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.409726 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.409963 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.410061 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.410266 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.410362 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.410578 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.410665 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.410883 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.410970 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.411198 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.411286 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.411499 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.411595 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.411829 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.411915 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.412154 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.412247 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.412463 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.412551 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.412774 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.412874 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.413089 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.413177 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.413390 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.413489 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.413690 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.413786 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.413990 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.414077 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.414291 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.414378 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.414598 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.414755 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.414900 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.414992 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.415147 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.415235 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.415445 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.415578 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.415745 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.415832 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.416043 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.416151 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.416367 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.416469 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.416672 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.416758 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.416976 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.417151 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.417311 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.417465 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.417606 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.417750 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.417887 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.418024 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.418174 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.418314 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.418450 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.418585 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.418727 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.418863 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.419017 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.419154 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.419304 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.419448 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.419610 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.419704 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.419843 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.419934 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.420168 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.420262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.420467 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.420568 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.420765 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.420852 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.421066 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.421156 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.421368 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.421472 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.421669 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.421758 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.421967 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.422069 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.422269 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.422359 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.422571 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.422661 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.422871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.422957 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.423175 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.423268 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.423474 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.423565 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.423776 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.423872 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.424073 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.424254 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.424399 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.424498 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.424703 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.424792 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.424995 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.425091 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.425297 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.425395 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.425620 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.425731 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.425923 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.426032 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.426223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.426319 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.426522 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.426618 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.426821 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.426943 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.427138 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.427246 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.427408 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.427495 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.427707 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.427795 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.428001 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.428088 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.428318 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.428419 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.428617 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.428706 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.428915 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.429009 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.429224 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.429323 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.429526 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.429670 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.429827 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.429915 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.430128 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.430226 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.430430 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.430521 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.430745 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:44:38.430833 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.431088 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.431183 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.431401 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.431525 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.431729 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.431831 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.432045 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.432170 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.432386 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.432489 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.432693 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.432789 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.433003 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.433102 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.433325 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.433421 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.433636 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.433722 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.433941 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.434029 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.434248 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.434335 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.434556 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.434651 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.434868 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.434955 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.435185 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.435306 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.435493 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.435581 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.435808 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.435904 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.436143 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.436236 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.436453 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.436539 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.436769 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.436866 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.437078 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.437164 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.437394 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.437488 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.437704 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.437793 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.438027 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.438112 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.438344 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.438443 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.438664 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.438759 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.438987 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.439077 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.439312 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.439400 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.439622 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.439755 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.439933 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.440029 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.440267 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.440408 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.440581 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.440677 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.440900 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.440988 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.441728 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.441833 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.442044 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.442132 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.442357 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.442451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.442666 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.442763 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.442978 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.443064 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.443281 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.443375 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.443590 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.443686 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.443902 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.443990 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.444238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.444332 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.444556 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.444645 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.444867 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.444960 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.445179 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.445266 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.445485 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.445573 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.445796 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.445954 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.446086 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.446184 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.446388 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.446477 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.446691 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.446777 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.446991 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.447085 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.447294 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.447384 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.447594 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.447682 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.447906 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.448003 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.448239 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.448343 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.448541 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.448639 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.448869 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.448966 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.449171 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.449268 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.449475 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.449561 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.449790 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.449887 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.450097 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.450191 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.450395 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.450482 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.450704 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.450802 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.451011 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.451099 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.451310 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.451396 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.451619 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.451714 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.451921 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.452008 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.452253 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.452347 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.452564 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.452653 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.452862 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.452949 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.453164 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.453251 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.453469 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.453565 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.453772 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.453869 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.454080 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.454168 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.454387 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.454475 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.454690 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.454776 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.455000 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.455088 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.455307 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.455394 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.455615 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.455702 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.455926 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.456023 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.456265 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.456357 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.456588 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.456685 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.457474 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.457582 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.458054 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.458154 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.458369 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.458463 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.458695 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.458797 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.458998 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.459085 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.459301 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.459397 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.459603 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.459699 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.459904 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.459991 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.460234 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.460327 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.460534 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.460622 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.460837 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.460935 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.461141 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.461228 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.461443 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.461531 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.461738 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.461831 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.462041 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.462127 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.462388 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.462477 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.462635 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.462723 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.462936 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.463039 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.463237 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.463326 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.463545 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.463640 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.463858 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.464091 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.464244 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.464541 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.464752 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.464843 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.465159 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.465288 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.465644 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.465738 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.465989 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.466222 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.466344 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.466631 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.466795 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.466954 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.467229 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.467369 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.467550 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.467692 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.467854 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.468206 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.468296 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.468521 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.468842 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.468939 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.469154 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.469424 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.469513 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.469777 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.470032 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.470122 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.470393 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.470481 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.470728 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.470836 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.471058 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.471158 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.471387 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.471475 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.471767 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.471919 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.472089 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.472462 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.472553 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.472780 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.472869 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.473091 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.473189 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.473401 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.473497 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.473711 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.473806 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.474077 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.474201 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.474399 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.474711 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.474806 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.475022 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.475176 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.475386 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.475505 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.475727 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.475855 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.476020 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.476151 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.476362 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.476465 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.476661 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.476750 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.476974 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.477089 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.477388 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.477520 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.477715 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.477850 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.478024 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.478166 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.478333 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.478555 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.478645 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.478876 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.479050 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.479203 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.479301 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.479596 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.479694 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.479900 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.480044 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.480234 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.480443 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.480533 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.480815 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.480917 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.481130 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.481221 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.481438 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.481527 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.481739 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.481839 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.482053 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.482144 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.482362 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.482453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.482670 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.482786 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.482971 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.483119 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.483274 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.483443 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.483589 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.483771 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.483893 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.484103 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.484256 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.484458 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.484571 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.484782 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.484883 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.485101 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.485191 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.485419 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.485515 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.485727 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.485816 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.486032 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.486120 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.486335 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.486475 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.486638 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.486737 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.486966 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.487112 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.487274 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.487397 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.487577 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.487669 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.487890 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.487980 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.488756 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.488859 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.489065 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.489154 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.489380 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.489510 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.489688 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.489842 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.489994 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.490161 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.490312 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.490477 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.490630 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.490794 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.490954 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.491145 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.491288 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.491465 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.491613 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.491777 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.491916 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.492099 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.492247 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.492448 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.492554 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.492761 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.492850 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.493087 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.493184 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.493403 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.493494 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.493713 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.493801 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.494021 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.494110 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.494337 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.494427 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.494650 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.494910 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.494998 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.495242 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.495338 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.495556 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.495645 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.495900 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.495996 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.496206 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.496311 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.496525 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.496613 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.496838 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.496924 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.497156 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.497255 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.497471 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.497571 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.497777 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.497894 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.498087 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.498179 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.498390 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.498664 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.498752 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.498984 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.499072 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.499286 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.499388 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.499589 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.499677 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.499890 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.499978 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.500217 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.500309 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.500527 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.500615 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.500831 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.500958 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.501133 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.501275 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.501434 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.501592 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.501744 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.501915 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.502046 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.502231 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.502354 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.502544 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.502640 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.502864 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.502952 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.503180 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.503271 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.503494 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.503583 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.504387 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.504567 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.504743 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.504881 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.505010 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.505228 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.505316 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.505538 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.505626 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.505878 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.505967 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.506207 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.506295 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.506513 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.506609 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.506834 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.506932 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.507132 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.507219 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.507473 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.507618 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.507759 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.507848 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.508061 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.508194 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.508389 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.508478 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.508698 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.508793 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.509006 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.509103 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.509308 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.509405 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.509616 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.509704 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.509923 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.510020 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.510231 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.510326 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.510540 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.510628 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.510842 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.510947 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.511150 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.511241 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.511450 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.511539 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.511763 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.511860 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.512071 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.512216 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.512397 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.512485 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.512697 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.512785 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.513005 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.513094 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.513312 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.513407 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.513615 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.513712 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.513923 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.514011 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.514220 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.514306 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.514527 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.514616 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.514824 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.514910 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.515124 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.515225 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.515426 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.515520 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.515731 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.515829 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.516035 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.516171 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.516356 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.516445 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.516673 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.516806 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.516975 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.517081 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.517275 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.517367 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.517577 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.517710 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.517880 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.517976 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.518176 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.518263 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.518477 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.518565 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.518783 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.518873 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.519085 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.519180 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.519443 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.519532 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.519744 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.519839 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.520051 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.520173 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.520375 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.520463 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.520685 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.520782 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.520988 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.521084 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.521295 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.521392 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.521595 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.521686 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.521899 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.521986 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.522197 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.522293 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.522499 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.522588 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.522801 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.522896 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.523120 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.523217 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.523425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.523513 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.523722 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.523808 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.524030 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.524159 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.524404 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.524493 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.524716 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.524804 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.525030 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.525131 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.525341 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.525431 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.525650 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.525739 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.525960 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.526050 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.526269 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.526367 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.526573 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.526660 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.526883 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.526972 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.527194 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.527281 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.527494 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.527588 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.527802 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.527891 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.528106 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.528238 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.528440 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.528536 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.528742 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.528832 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.529044 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.529132 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.529362 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.529451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.529669 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.529760 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.529975 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.530064 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.530293 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.530390 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.530618 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.530706 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.530938 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.531024 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.531234 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.531329 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.531540 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.531629 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.531848 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.531935 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.532176 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.532281 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.532485 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.532573 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.532788 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.532882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.533097 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.533269 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.533406 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.533495 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.533713 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.533811 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.534023 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.534124 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.534330 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.534418 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.534633 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.534721 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.534965 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.535054 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.536858 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537020 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537117 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537200 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537298 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537384 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537465 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537544 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537544 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537687 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.537780 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538316 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538462 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538558 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538642 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538735 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538735 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538881 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538961 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.538961 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.539237 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.539340 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.540427 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541057 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541148 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541230 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541311 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541311 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541454 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541520 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541520 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541670 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541670 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541907 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.541980 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.542265 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.542448 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.542604 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.542886 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.543005 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.543205 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.543300 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.543521 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.543649 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.543833 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.543975 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.544161 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.544327 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.544478 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.544644 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.544803 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.544964 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.545111 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.545286 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.545416 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.545612 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.545711 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.545935 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.546026 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.546251 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.546341 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.546620 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.546710 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.546984 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.547096 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.547309 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.547411 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.547618 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.547716 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.547931 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.548081 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.548271 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.548409 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.548594 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.548688 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.548926 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.549015 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.549240 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.549329 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.549554 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.549644 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.549856 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.550047 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.550340 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.550448 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.551162 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.551257 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.551499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.551588 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.551823 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.551923 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.552165 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.552277 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.552490 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.552590 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.552800 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.552975 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.553124 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.553297 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.553448 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.553618 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.553768 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.553953 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.554092 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.554287 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.554507 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.554604 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.554834 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.554923 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.555144 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.555243 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.555472 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.555580 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.555794 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.555892 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.556106 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.556261 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.556432 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.556523 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.556742 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.556831 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.557048 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.557145 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.557354 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.557442 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.557676 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.557774 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.557981 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.558122 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.558290 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.558392 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.558599 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.558744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.558906 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.559074 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.559209 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.559391 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.559514 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.559721 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.559820 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.560059 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.560180 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.560400 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.560501 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.560712 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.560810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.561028 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.561117 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.561338 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.561430 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.561645 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.561742 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.561966 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.562056 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.562273 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.562369 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.562573 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.562661 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.562876 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.562964 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.563179 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.563277 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.563482 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.563570 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.563793 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.563888 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.564112 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.564245 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.564447 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.564545 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.564772 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.564860 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.565083 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.565187 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.565408 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.565497 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.565729 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.565823 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.566037 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.566135 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.566892 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.566989 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.567215 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.567332 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.567515 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.567616 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.567818 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.567925 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.568148 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.568253 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.568449 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.568539 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.568753 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.568842 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.569056 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.569144 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.569362 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.569452 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.569663 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.569752 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.569964 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.570052 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.570266 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.570364 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.570585 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.570674 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.570889 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.571059 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.571203 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.571350 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.571507 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.571599 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.571817 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.571919 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.572113 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.572224 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.572436 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.572525 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.572772 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.572874 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.573075 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.573164 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.573402 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.573491 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.573711 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.573807 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.574023 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.574120 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.574334 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.574423 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.574635 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.574723 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.574956 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.575045 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.575261 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.575348 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.575569 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.575718 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.575896 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.576050 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.576205 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.576301 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.576514 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.576605 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.576818 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.576905 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.577124 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.577210 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.577429 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.577533 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.577742 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.577842 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.578053 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.578152 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.578365 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.578461 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.578712 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.578899 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.579028 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.579228 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.579356 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.579542 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.579680 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.579856 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.580008 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.580190 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.580359 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.580503 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.580680 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.580814 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.581000 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.581125 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.581319 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.581426 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.581638 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.581733 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.582000 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.582099 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.582322 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.582411 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.582642 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.582737 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.583217 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.583310 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.583545 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.583755 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.583845 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.584091 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.584272 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.584438 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.584534 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.584757 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.584846 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.585075 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.585173 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.585392 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.585483 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.585691 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.585779 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.586011 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.586101 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.586322 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.586409 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.586630 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.586729 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.586938 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.587034 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.587248 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.587426 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.587554 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.587654 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.587867 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.587968 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.588195 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.588288 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.588507 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.588619 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.588817 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.588961 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.589129 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.589219 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.589450 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.589540 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.589783 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.589873 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.590102 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.590198 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.590411 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.590503 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.590721 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.590810 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.591034 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.591122 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.591350 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.591546 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.591670 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.591856 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.591985 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.592206 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.592342 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.592530 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.592662 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.592848 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.592980 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.593161 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.593297 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.593473 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.593615 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.593794 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.593936 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.594095 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.594264 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.594397 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.594602 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.594691 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.594929 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.595019 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.595249 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.595345 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.595568 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.595664 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.595877 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.596010 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.596198 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.596459 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.596549 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.596806 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.596904 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.597160 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.597334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.597543 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.597704 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.597902 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.598036 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.598251 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.598362 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.598597 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.598700 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.598939 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.599035 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.599229 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.599328 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.599550 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.599642 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.599855 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.599958 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.600177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.600273 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.600493 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.600595 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.600805 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.600906 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.601108 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.601241 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.601411 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.601598 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.601700 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.601909 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.602013 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.602247 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.602374 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.602583 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.602809 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.602902 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.603164 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.603254 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.603478 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.603580 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.603778 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.603870 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.604079 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.604186 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.604411 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.604520 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.604713 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.604805 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.605016 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.605105 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.605318 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.605418 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.605617 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.605707 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.605933 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.606046 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.606235 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.606389 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.606540 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.606738 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.606836 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.607054 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.607160 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.607391 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.607482 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.607705 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.607793 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.608032 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.608151 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.608384 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.608494 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.608688 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.608779 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.608990 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.609088 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.609302 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.609401 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.609609 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.609700 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.609927 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.610026 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.610237 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.610327 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.610544 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.610634 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.610883 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.610988 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.611196 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.611289 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.611550 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.611731 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.611890 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.612063 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.612313 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.612396 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.612592 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.612750 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.613956 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.614594 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.615183 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.615555 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.615900 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616237 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616345 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616433 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616517 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616608 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616608 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616774 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616857 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.616937 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617023 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617105 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617184 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617272 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617360 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617441 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617520 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617599 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617687 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617769 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617849 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.617929 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618008 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618185 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618296 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618296 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618446 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618527 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618613 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618727 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.618925 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.619017 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.619159 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.619307 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.619481 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.619572 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.619796 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.619921 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.620111 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.620286 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.620448 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.620620 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.620764 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.620942 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.621073 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.621297 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.621395 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.621639 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.621795 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.621967 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.622055 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.622282 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.622370 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.622610 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.622701 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.622924 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.623012 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.623229 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.623326 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.623586 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.623673 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.623922 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.624010 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.624263 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.624367 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.624584 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.624672 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.624893 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.624981 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.625213 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.625310 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.625534 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.625623 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.625843 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.625931 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.626165 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.626254 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.626473 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.626561 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.626800 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.626888 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.627135 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.627224 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.627461 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.627556 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.627782 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.627871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.628087 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.628248 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.628418 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.628537 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.629352 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.629477 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.629644 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.629745 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.629964 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.630065 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.630276 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.630420 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.630579 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.630765 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.630881 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.631102 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.631191 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.631477 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.631566 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.631780 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.631877 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.632083 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.632208 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.632410 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.632558 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.632717 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.632894 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.633016 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.633240 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.633367 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.633587 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.633677 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.633892 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.633994 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.634196 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.634297 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.634494 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.634584 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.634800 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.634896 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.635100 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.635259 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.635400 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.635628 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.635717 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.635975 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.636066 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.636518 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.636658 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.636797 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.636892 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.636985 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.637068 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.637227 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.637324 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.637545 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.637634 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.637855 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.637945 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.638172 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.638273 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.638481 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.638594 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.638800 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.638910 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.639117 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.639217 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.639428 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.639542 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.639734 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.639824 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.640063 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.640173 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.640394 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.640522 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.640704 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.640853 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.641013 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.641183 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.641320 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.641521 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.641621 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.641842 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.641932 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.642171 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.642269 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.642506 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.642605 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.642816 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.642906 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.643138 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.643236 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.643454 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.643550 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.643770 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.643867 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.644083 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.644237 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.644445 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.644554 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.644770 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.644860 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.645078 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.645176 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.645387 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.645488 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.645694 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.645810 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.646003 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.646149 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.646316 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.646505 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.646630 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.646830 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.646929 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.647179 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.647276 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.647505 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.647601 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.647821 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.647923 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.648154 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.648245 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.648476 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.648577 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.648789 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.648899 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.649100 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.649188 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.649417 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.649505 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.649732 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.649829 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.650050 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.650146 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.650371 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.650461 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.650693 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.650790 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.651005 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.651094 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.651311 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.651399 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.651609 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.651697 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.651850 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:44:38.651939 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.652283 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.652606 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.652922 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.653255 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.653570 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.653886 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.654201 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.654520 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.654833 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.655154 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.655468 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.655781 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.656101 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.656446 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.656781 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.657112 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.657427 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.657755 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.658083 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.658435 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.658752 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.659101 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.659436 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.659756 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.660099 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.660443 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:44:38.660692 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:44:38.808108 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO dbcounter [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Registered counter for database nova_api Aug 02 08:44:38.830855 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_db.sqlalchemy.engines [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:44:38.837852 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writer thread running {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:44:38.842133 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO dbcounter [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Registered counter for database nova_api Aug 02 08:44:38.862082 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG oslo_db.sqlalchemy.engines [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:44:38.869135 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writer thread running {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:44:38.893812 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.context [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58122f4c-a1ac-4fa0-ab3e-697d06b208ce(cell1) {{(pid=103205) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 08:44:38.897765 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:44:38.899432 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:44:38.900250 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:44:38.902201 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:44:38.904191 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO dbcounter [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Registered counter for database nova_cell0 Aug 02 08:44:38.911271 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO dbcounter [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Registered counter for database nova_cell1 Aug 02 08:44:38.918871 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_db.sqlalchemy.engines [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:44:38.921075 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_db.sqlalchemy.engines [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:44:38.925375 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.context [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58122f4c-a1ac-4fa0-ab3e-697d06b208ce(cell1) {{(pid=103204) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 08:44:38.926502 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writer thread running {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:44:38.929990 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG oslo_concurrency.lockutils [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:44:38.931621 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG oslo_concurrency.lockutils [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:44:38.931759 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writer thread running {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:44:38.932451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG oslo_concurrency.lockutils [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:44:38.934447 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG oslo_concurrency.lockutils [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:44:38.936458 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO dbcounter [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Registered counter for database nova_cell0 Aug 02 08:44:38.941877 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO dbcounter [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Registered counter for database nova_cell1 Aug 02 08:44:38.948816 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG oslo_db.sqlalchemy.engines [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:44:38.952322 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG oslo_db.sqlalchemy.engines [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:44:38.954751 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writer thread running {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:44:39.073749 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO dbcounter [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Registered counter for database nova_cell0 Aug 02 08:44:39.082081 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_db.sqlalchemy.engines [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:44:39.089109 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writer thread running {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:44:39.099544 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writer thread running {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:44:39.109605 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO dbcounter [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Registered counter for database nova_cell0 Aug 02 08:44:39.117391 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG oslo_db.sqlalchemy.engines [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:44:39.122121 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writer thread running {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:44:39.437050 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: WARNING keystonemiddleware.auth_token [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:44:39.444575 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: WARNING keystonemiddleware.auth_token [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:44:39.445592 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: WARNING keystonemiddleware.auth_token [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:44:39.452998 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: WARNING keystonemiddleware.auth_token [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:44:39.788545 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: WARNING keystonemiddleware.auth_token [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:44:39.794480 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: WARNING keystonemiddleware.auth_token [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:44:39.796391 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: WARNING keystonemiddleware.auth_token [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:44:39.799825 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558177cc29c0 pid: 103205 (default app) Aug 02 08:44:39.802002 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:44:39.802424 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: WARNING keystonemiddleware.auth_token [None req-679b81cc-693a-44f3-a42f-deb8f619182c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:44:39.803216 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001781 Aug 02 08:44:39.803620 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Tue Aug 2 08:44:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:44:39.807781 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558177cc29c0 pid: 103204 (default app) Aug 02 08:45:58.258908 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:45:58.259922 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 02 08:45:58.260367 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:45:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:45:58.277566 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writing DB stats nova_api:SELECT=3 {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:58.278525 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writing DB stats nova_cell0:SELECT=3 {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:58.279669 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writing DB stats nova_cell1:SELECT=3 {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:58.280692 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writing DB stats nova_cell0:SELECT=3 {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:45:59.237202 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4a8895b9-8abf-42c1-a796-0be2406d0862 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:45:59.270970 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4a8895b9-8abf-42c1-a796-0be2406d0862 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.003494 Aug 02 08:45:59.278963 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Aug 2 08:45:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:46:01.568305 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:01.570469 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-615d165e-1764-4d1c-bff8-c5326c4b5a4a None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002841 Aug 02 08:46:01.571678 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:02.112822 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-960931bc-12c9-4c23-81de-9c41bdc8092f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:02.134115 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:46:02.134115 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: warnings.warn(msg) Aug 02 08:46:02.165180 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-960931bc-12c9-4c23-81de-9c41bdc8092f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.586586 Aug 02 08:46:02.168555 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:46:02.399675 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-164e2911-43a1-400f-b78a-8295bc07ddfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:02.404482 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:46:02.404482 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: warnings.warn(msg) Aug 02 08:46:02.407436 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_api:SELECT=3 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:02.408958 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_cell0:SELECT=3 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:02.409991 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_cell1:SELECT=3 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:02.410710 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:02.475620 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-164e2911-43a1-400f-b78a-8295bc07ddfd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301229 Aug 02 08:46:02.476419 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Aug 2 08:46:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:46:04.780495 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-960931bc-12c9-4c23-81de-9c41bdc8092f admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:04.781762 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-960931bc-12c9-4c23-81de-9c41bdc8092f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Aug 02 08:46:04.782224 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:05.549999 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-346cb8bf-51e8-42e0-bee3-915f4b073269 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "vcpus": 1, "disk": 5}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:05.569156 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:46:05.569156 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: warnings.warn(msg) Aug 02 08:46:05.591812 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-346cb8bf-51e8-42e0-bee3-915f4b073269 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.800765 Aug 02 08:46:05.592598 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:46:05.605332 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e09b9250-41d7-43ca-abfd-0626197041f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:05.608681 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:46:05.608681 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: warnings.warn(msg) Aug 02 08:46:05.645216 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e09b9250-41d7-43ca-abfd-0626197041f9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043704 Aug 02 08:46:05.654086 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Aug 2 08:46:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:46:07.959568 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-346cb8bf-51e8-42e0-bee3-915f4b073269 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:07.960734 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-346cb8bf-51e8-42e0-bee3-915f4b073269 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Aug 02 08:46:07.961131 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:46:08.366614 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-085ea0df-4204-42c3-92bd-8bfa5eb1d445 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "vcpus": 1, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:08.385981 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-085ea0df-4204-42c3-92bd-8bfa5eb1d445 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.416169 Aug 02 08:46:08.386480 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 08:46:08.398883 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-ae675d14-bd75-49c8-b465-63d4b0735621 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:08.421975 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-ae675d14-bd75-49c8-b465-63d4b0735621 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026812 Aug 02 08:46:08.422716 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Aug 2 08:46:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:46:10.656996 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-085ea0df-4204-42c3-92bd-8bfa5eb1d445 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:10.659183 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-085ea0df-4204-42c3-92bd-8bfa5eb1d445 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002666 Aug 02 08:46:10.665080 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:10 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:11.162923 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-c6e8ff51-85cd-42ee-9cf0-07bd323dea6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:11.194367 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-c6e8ff51-85cd-42ee-9cf0-07bd323dea6e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.523133 Aug 02 08:46:11.195710 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:46:11.211660 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-ea8e3fad-dc6e-42f0-92f6-f05bd8d2b362 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:11.253187 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-ea8e3fad-dc6e-42f0-92f6-f05bd8d2b362 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048571 Aug 02 08:46:11.253907 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Aug 2 08:46:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:46:13.583501 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-c6e8ff51-85cd-42ee-9cf0-07bd323dea6e admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:13.584604 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-c6e8ff51-85cd-42ee-9cf0-07bd323dea6e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Aug 02 08:46:13.585285 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:14.130150 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-f0deed99-ceb9-490f-8e54-c1935807c1ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:14.154185 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-f0deed99-ceb9-490f-8e54-c1935807c1ca admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562034 Aug 02 08:46:14.155117 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:46:14.169752 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-bc2bd833-1be5-4789-a7e3-8439c043e03e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:14.197814 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-bc2bd833-1be5-4789-a7e3-8439c043e03e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033606 Aug 02 08:46:14.204548 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Aug 2 08:46:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:46:16.548462 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-f0deed99-ceb9-490f-8e54-c1935807c1ca admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:16.550084 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-f0deed99-ceb9-490f-8e54-c1935807c1ca admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Aug 02 08:46:16.550492 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:17.085972 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-220a8eac-af75-420b-9562-9c1dae4c32ce admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:17.112160 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-220a8eac-af75-420b-9562-9c1dae4c32ce admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.555171 Aug 02 08:46:17.112711 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Aug 2 08:46:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:46:19.360231 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-f0deed99-ceb9-490f-8e54-c1935807c1ca admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:19.361856 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-f0deed99-ceb9-490f-8e54-c1935807c1ca admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 02 08:46:19.362198 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:19.935159 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-b026a0ab-bb72-4f88-b8d6-2566a02847c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:19.974809 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-b026a0ab-bb72-4f88-b8d6-2566a02847c6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.605854 Aug 02 08:46:19.975897 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:46:19.990532 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-06f34793-2793-47b5-97b3-27ab61f0031d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:20.022614 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-06f34793-2793-47b5-97b3-27ab61f0031d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037458 Aug 02 08:46:20.023443 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Aug 2 08:46:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:46:22.692105 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-b026a0ab-bb72-4f88-b8d6-2566a02847c6 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:22.693191 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-b026a0ab-bb72-4f88-b8d6-2566a02847c6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 02 08:46:22.693714 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:23.152833 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-d98a771f-59e7-46d0-91ef-ded3675a0c74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20, "swap": 0}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:23.172201 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-d98a771f-59e7-46d0-91ef-ded3675a0c74 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472389 Aug 02 08:46:23.172766 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:46:23.185550 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5b24ab7f-30e6-4e8c-84b2-46e91f230630 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:23.214378 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5b24ab7f-30e6-4e8c-84b2-46e91f230630 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032340 Aug 02 08:46:23.215387 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Aug 2 08:46:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:46:25.468888 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-d98a771f-59e7-46d0-91ef-ded3675a0c74 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:25.469900 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-d98a771f-59e7-46d0-91ef-ded3675a0c74 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 02 08:46:25.470308 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:25.865101 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-90a0735b-3031-4dc9-af87-18631da9116c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "swap": 0}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:25.884413 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-90a0735b-3031-4dc9-af87-18631da9116c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.407749 Aug 02 08:46:25.884975 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:46:25.897344 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-f1919bf5-afb7-437e-85bd-4ef7dd44b705 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:25.924762 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-f1919bf5-afb7-437e-85bd-4ef7dd44b705 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031304 Aug 02 08:46:25.925348 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Aug 2 08:46:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:46:28.332811 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-90a0735b-3031-4dc9-af87-18631da9116c admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:28.334545 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-90a0735b-3031-4dc9-af87-18631da9116c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002583 Aug 02 08:46:28.336430 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:28.951100 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-49cb90c0-fbfe-484e-8d18-9498f648ce83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "rxtx_factor": 1.0}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:28.958534 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:28.974570 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-49cb90c0-fbfe-484e-8d18-9498f648ce83 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.633073 Aug 02 08:46:28.975143 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 08:46:28.988201 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5971f9bd-093c-46ef-a137-3f683f5afbb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:29.014194 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5971f9bd-093c-46ef-a137-3f683f5afbb5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030312 Aug 02 08:46:29.014922 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Aug 2 08:46:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:46:31.416862 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-49cb90c0-fbfe-484e-8d18-9498f648ce83 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:31.417875 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-49cb90c0-fbfe-484e-8d18-9498f648ce83 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Aug 02 08:46:31.418278 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:46:31.970205 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5941d5ce-8e58-4f13-b180-52b8280c23db admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:31.992025 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5941d5ce-8e58-4f13-b180-52b8280c23db admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.567079 Aug 02 08:46:31.992777 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Aug 2 08:46:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:46:32.007769 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-5816672c-a26c-4ce6-ae42-f595b59d3ea6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:32.038801 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-5816672c-a26c-4ce6-ae42-f595b59d3ea6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035668 Aug 02 08:46:32.039669 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Aug 2 08:46:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:46:52.567654 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5941d5ce-8e58-4f13-b180-52b8280c23db admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:52.568712 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5941d5ce-8e58-4f13-b180-52b8280c23db admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 02 08:46:52.569118 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:52.580267 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:52.970500 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-1a69927e-979b-4a89-abfd-e818f5ff5fd4 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:52.990082 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-1a69927e-979b-4a89-abfd-e818f5ff5fd4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414858 Aug 02 08:46:52.990546 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Aug 2 08:46:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:46:54.200153 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5941d5ce-8e58-4f13-b180-52b8280c23db admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:54.201175 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5941d5ce-8e58-4f13-b180-52b8280c23db admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 02 08:46:54.201576 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:54.735798 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-6b883a07-b4cf-46e4-bf5a-6bdd963bd09d admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:54.741401 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.wsgi [None req-6b883a07-b4cf-46e4-bf5a-6bdd963bd09d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-6b883a07-b4cf-46e4-bf5a-6bdd963bd09d admin admin] Request method failure captured: Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Accept: application/json Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Accept-Encoding: gzip, deflate Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Connection: keep-alive Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Content-Length: 0 Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Host: 10.222.0.17 Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Openstack-Api-Version: compute 2.90 Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Openstack-System-Scope: None Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: User-Agent: python-novaclient Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Auth-Token: gAAAAABi6OR-KCE8H0eCO045hgvH98A-e76mjTS0e02qql-9gUMf6KnzKKvs6gurS6Yha85fZ0G3DZttzSR6JfZTZDXBbVNUbUt2RtbqUP4Ip4sYqRBER7LEWXnPmbGmkB9-bokbV9pfdKa2np8TL2a01l6p8YySDOyApdIxg3M8dgxhuXFvgF4 Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Domain-Id: None Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Domain-Name: None Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Identity-Status: Confirmed Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Is-Admin-Project: True Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Domain-Id: default Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Domain-Name: Default Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Name: admin Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Role: reader,admin,member Aug 02 08:46:54.744722 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Roles: reader,admin,member Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373878c44f1d4227ba8ac54103602eff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}] Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant: admin Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant-Name: admin Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User: admin Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Domain-Id: default Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Domain-Name: Default Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Id: 5c37b28fc7d64a6c86abaeae5a87cc16 Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Name: admin Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: method: > Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: exception: Flavor 42 could not be found. Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: action_args: {'id': '42'} Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:46:54.746451 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:54.747499 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.749001 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-6b883a07-b4cf-46e4-bf5a-6bdd963bd09d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:46:54.750270 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-6b883a07-b4cf-46e4-bf5a-6bdd963bd09d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405308 Aug 02 08:46:54.750270 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 2 08:46:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:54.756519 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-e8aa2439-9340-44a1-9b76-071ca324260a admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:54.760695 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:46:54.780667 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-e8aa2439-9340-44a1-9b76-071ca324260a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027681 Aug 02 08:46:54.781238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 2 08:46:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:46:54.795435 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-c10f73da-fb35-4785-8f7a-8adc68199ace admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:54.822852 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-c10f73da-fb35-4785-8f7a-8adc68199ace admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035125 Aug 02 08:46:54.823411 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 2 08:46:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:46:54.834017 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-fa70166c-408b-4763-952e-efe6086a3f6c admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:54.840553 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.wsgi [None req-fa70166c-408b-4763-952e-efe6086a3f6c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-fa70166c-408b-4763-952e-efe6086a3f6c admin admin] Request method failure captured: Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Accept: application/json Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Accept-Encoding: gzip, deflate Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Connection: keep-alive Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Content-Length: 0 Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Host: 10.222.0.17 Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Openstack-Api-Version: compute 2.90 Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Openstack-System-Scope: None Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: User-Agent: python-novaclient Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Auth-Token: gAAAAABi6OR-KCE8H0eCO045hgvH98A-e76mjTS0e02qql-9gUMf6KnzKKvs6gurS6Yha85fZ0G3DZttzSR6JfZTZDXBbVNUbUt2RtbqUP4Ip4sYqRBER7LEWXnPmbGmkB9-bokbV9pfdKa2np8TL2a01l6p8YySDOyApdIxg3M8dgxhuXFvgF4 Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Domain-Id: None Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Domain-Name: None Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Identity-Status: Confirmed Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Is-Admin-Project: True Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Domain-Id: default Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Domain-Name: Default Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Name: admin Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Role: reader,admin,member Aug 02 08:46:54.843815 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Roles: reader,admin,member Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373878c44f1d4227ba8ac54103602eff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}] Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant: admin Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant-Name: admin Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User: admin Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Domain-Id: default Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Domain-Name: Default Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Id: 5c37b28fc7d64a6c86abaeae5a87cc16 Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Name: admin Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: method: > Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: exception: Flavor 42 could not be found. Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: action_args: {'id': '42'} Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:46:54.845221 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:54.846047 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:54.847262 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-fa70166c-408b-4763-952e-efe6086a3f6c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:46:54.848519 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-fa70166c-408b-4763-952e-efe6086a3f6c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015814 Aug 02 08:46:54.848519 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 2 08:46:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:55.826955 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-c10f73da-fb35-4785-8f7a-8adc68199ace admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:55.827969 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-c10f73da-fb35-4785-8f7a-8adc68199ace admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 02 08:46:55.828412 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:56.367421 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-f31fadfa-20e3-4168-a953-b109ddb6da07 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:56.372738 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.wsgi [None req-f31fadfa-20e3-4168-a953-b109ddb6da07 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-f31fadfa-20e3-4168-a953-b109ddb6da07 admin admin] Request method failure captured: Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Accept: application/json Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Accept-Encoding: gzip, deflate Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Connection: keep-alive Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Content-Length: 0 Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Host: 10.222.0.17 Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Openstack-Api-Version: compute 2.90 Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Openstack-System-Scope: None Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: User-Agent: python-novaclient Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Auth-Token: gAAAAABi6OR_Chq2ihLbN5-cdJwVcDDMkYtbBlYqN37HUAFjZipxIAquo6CZLY6l3cxBVZt9ezyHu2Z57PjqdJHjYQMk4Pvgm5im__pqc8n4eRgkG1-qigeIRXsglYr3mGKFzkzUZZbZN_16sqjKoACjDF90Rz0EnjWrIXVuAi1Qmw-EYp0dgC4 Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Domain-Id: None Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Domain-Name: None Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Identity-Status: Confirmed Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Is-Admin-Project: True Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Domain-Id: default Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Domain-Name: Default Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Name: admin Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Role: reader,admin,member Aug 02 08:46:56.374223 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Roles: reader,admin,member Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373878c44f1d4227ba8ac54103602eff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}] Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant: admin Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant-Name: admin Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User: admin Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Domain-Id: default Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Domain-Name: Default Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Id: 5c37b28fc7d64a6c86abaeae5a87cc16 Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Name: admin Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: method: > Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: exception: Flavor 84 could not be found. Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: action_args: {'id': '84'} Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:46:56.375810 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:56.377177 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.378238 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-f31fadfa-20e3-4168-a953-b109ddb6da07 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:46:56.379230 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-f31fadfa-20e3-4168-a953-b109ddb6da07 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.406360 Aug 02 08:46:56.379230 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 2 08:46:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:56.385832 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-545ee87b-2188-4925-90a8-7a828a5bb753 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:56.401475 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-545ee87b-2188-4925-90a8-7a828a5bb753 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019186 Aug 02 08:46:56.402244 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 2 08:46:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:46:56.411738 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5f5c0724-eabe-4bf0-90ba-876c46360904 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:56.428366 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5f5c0724-eabe-4bf0-90ba-876c46360904 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019881 Aug 02 08:46:56.428907 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 2 08:46:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:46:56.438407 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-704d1520-88bd-464f-9ce0-290cccc6f6d2 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:56.444390 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.wsgi [None req-704d1520-88bd-464f-9ce0-290cccc6f6d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-704d1520-88bd-464f-9ce0-290cccc6f6d2 admin admin] Request method failure captured: Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Accept: application/json Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Accept-Encoding: gzip, deflate Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Connection: keep-alive Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Content-Length: 0 Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Host: 10.222.0.17 Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Openstack-Api-Version: compute 2.90 Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Openstack-System-Scope: None Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: User-Agent: python-novaclient Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Auth-Token: gAAAAABi6OR_Chq2ihLbN5-cdJwVcDDMkYtbBlYqN37HUAFjZipxIAquo6CZLY6l3cxBVZt9ezyHu2Z57PjqdJHjYQMk4Pvgm5im__pqc8n4eRgkG1-qigeIRXsglYr3mGKFzkzUZZbZN_16sqjKoACjDF90Rz0EnjWrIXVuAi1Qmw-EYp0dgC4 Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Domain-Id: None Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Domain-Name: None Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Identity-Status: Confirmed Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Is-Admin-Project: True Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Domain-Id: default Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Domain-Name: Default Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Name: admin Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Role: reader,admin,member Aug 02 08:46:56.445871 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Roles: reader,admin,member Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373878c44f1d4227ba8ac54103602eff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}] Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant: admin Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant-Name: admin Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User: admin Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Domain-Id: default Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Domain-Name: Default Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Id: 5c37b28fc7d64a6c86abaeae5a87cc16 Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Name: admin Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: method: > Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: exception: Flavor 84 could not be found. Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: action_args: {'id': '84'} Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:46:56.447425 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:56.448453 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:56.449778 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-704d1520-88bd-464f-9ce0-290cccc6f6d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:46:56.451021 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-704d1520-88bd-464f-9ce0-290cccc6f6d2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012357 Aug 02 08:46:56.451021 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 2 08:46:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:57.446779 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5f5c0724-eabe-4bf0-90ba-876c46360904 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:57.447832 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5f5c0724-eabe-4bf0-90ba-876c46360904 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 02 08:46:57.448268 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:46:57.972721 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-6208fbb2-7a31-4c23-83c7-f456d4dbc9f1 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:57.978362 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.wsgi [None req-6208fbb2-7a31-4c23-83c7-f456d4dbc9f1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-6208fbb2-7a31-4c23-83c7-f456d4dbc9f1 admin admin] Request method failure captured: Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Accept: application/json Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Accept-Encoding: gzip, deflate Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Connection: keep-alive Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Content-Length: 0 Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Host: 10.222.0.17 Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Openstack-Api-Version: compute 2.90 Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Openstack-System-Scope: None Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: User-Agent: python-novaclient Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Auth-Token: gAAAAABi6OSBg0V08mPhQA0Ec1PPfK_O5hHZhFvCyMB0-LbYvQ-aSNq3uB8uSzRgd9gkSCup97Xcwe8qvDdwrBHPrJoyt6QoBTXsOIypqz4hmugYPlKrPyzZw9zkxAUj0eEXU_n_U_aFcooxVhk-uN5ZtYOC1fSqOa7IMywElKlLRnmpx39wbJE Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Domain-Id: None Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Domain-Name: None Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Identity-Status: Confirmed Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Is-Admin-Project: True Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Domain-Id: default Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Domain-Name: Default Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Project-Name: admin Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Role: reader,admin,member Aug 02 08:46:57.979882 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Roles: reader,admin,member Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373878c44f1d4227ba8ac54103602eff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}] Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant: admin Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-Tenant-Name: admin Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User: admin Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Domain-Id: default Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Domain-Name: Default Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Id: 5c37b28fc7d64a6c86abaeae5a87cc16 Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: X-User-Name: admin Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: method: > Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: exception: Flavor 451 could not be found. Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: action_args: {'id': '451'} Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:46:57.981496 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:57.982460 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: ERROR nova.api.openstack.wsgi Aug 02 08:46:57.983744 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-6208fbb2-7a31-4c23-83c7-f456d4dbc9f1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:46:57.985036 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-6208fbb2-7a31-4c23-83c7-f456d4dbc9f1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394705 Aug 02 08:46:57.985036 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 2 08:46:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:57.991373 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-ffda806e-53b9-4ea1-bd08-c6b875a0c668 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:58.006834 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-ffda806e-53b9-4ea1-bd08-c6b875a0c668 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018946 Aug 02 08:46:58.007381 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 2 08:46:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:46:58.016916 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:58.031789 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018489 Aug 02 08:46:58.032385 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 2 08:46:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:46:58.041387 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-ded7a7dc-f8a8-46f2-a6aa-35f98be2cae0 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:58.046666 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.wsgi [None req-ded7a7dc-f8a8-46f2-a6aa-35f98be2cae0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-ded7a7dc-f8a8-46f2-a6aa-35f98be2cae0 admin admin] Request method failure captured: Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Accept: application/json Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Accept-Encoding: gzip, deflate Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Connection: keep-alive Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Content-Length: 0 Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Host: 10.222.0.17 Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Openstack-Api-Version: compute 2.90 Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Openstack-System-Scope: None Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: User-Agent: python-novaclient Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Auth-Token: gAAAAABi6OSBg0V08mPhQA0Ec1PPfK_O5hHZhFvCyMB0-LbYvQ-aSNq3uB8uSzRgd9gkSCup97Xcwe8qvDdwrBHPrJoyt6QoBTXsOIypqz4hmugYPlKrPyzZw9zkxAUj0eEXU_n_U_aFcooxVhk-uN5ZtYOC1fSqOa7IMywElKlLRnmpx39wbJE Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Domain-Id: None Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Domain-Name: None Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Identity-Status: Confirmed Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Is-Admin-Project: True Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Domain-Id: default Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Domain-Name: Default Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Project-Name: admin Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Role: reader,admin,member Aug 02 08:46:58.048684 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Roles: reader,admin,member Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_373878c44f1d4227ba8ac54103602eff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/373878c44f1d4227ba8ac54103602eff"}]}] Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant: admin Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant-Id: 373878c44f1d4227ba8ac54103602eff Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-Tenant-Name: admin Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User: admin Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Domain-Id: default Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Domain-Name: Default Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Id: 5c37b28fc7d64a6c86abaeae5a87cc16 Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: X-User-Name: admin Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: method: > Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: exception: Flavor 451 could not be found. Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: action_args: {'id': '451'} Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:46:58.050334 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:58.051187 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Aug 02 08:46:58.052264 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-ded7a7dc-f8a8-46f2-a6aa-35f98be2cae0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:46:58.053327 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-ded7a7dc-f8a8-46f2-a6aa-35f98be2cae0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012166 Aug 02 08:46:58.053327 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 2 08:46:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 08:46:59.027780 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:46:59.028891 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 02 08:46:59.029303 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:46:59.552467 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-1820347a-caf6-41fa-b4f7-c73a7e8bb912 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:46:59.571709 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-1820347a-caf6-41fa-b4f7-c73a7e8bb912 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.404007 Aug 02 08:46:59.572287 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 2 08:46:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:47:00.564766 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:00.565773 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 02 08:47:00.566166 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:47:01.102080 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-6ab9f880-1a5a-410f-bda0-e03f78aa45af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:47:01.120968 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-6ab9f880-1a5a-410f-bda0-e03f78aa45af admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.418949 Aug 02 08:47:01.121512 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 2 08:47:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:47:02.149689 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:02.150702 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 02 08:47:02.151095 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:47:02.684600 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-0a5c475f-8429-4125-9cdc-0e72752449f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:47:02.703138 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-0a5c475f-8429-4125-9cdc-0e72752449f9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407269 Aug 02 08:47:02.703622 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 2 08:47:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:47:03.681659 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:03.682702 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 02 08:47:03.683098 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:47:04.225403 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-8b87f179-0db7-4bf2-9d7a-a151f5a31d12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:47:04.246717 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-8b87f179-0db7-4bf2-9d7a-a151f5a31d12 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.424596 Aug 02 08:47:04.247341 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 2 08:47:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:47:05.220003 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:05.221152 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Aug 02 08:47:05.221562 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:47:05.754931 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-0005359d-da3b-4f24-bacb-206f5844eae9 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:05.775592 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-0005359d-da3b-4f24-bacb-206f5844eae9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412235 Aug 02 08:47:05.776164 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Tue Aug 2 08:47:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:47:58.410163 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:58.411258 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e7ed844a-caa1-4a70-9464-e55993c2737e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Aug 02 08:47:58.411660 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Tue Aug 2 08:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:47:58.423218 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:58.843634 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-03611d29-f262-438a-b0cb-1d7d03ec8945 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:58.865029 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-03611d29-f262-438a-b0cb-1d7d03ec8945 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.446995 Aug 02 08:47:58.865577 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Aug 2 08:47:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:47:58.887443 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG dbcounter [-] [103204] Writing DB stats nova_api:SELECT=14 {{(pid=103204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:47:58.891756 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-3b454437-bc1f-464f-b845-4159a6ec5ea0 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:58.899666 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-3b454437-bc1f-464f-b845-4159a6ec5ea0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013580 Aug 02 08:47:58.900324 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Tue Aug 2 08:47:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:47:58.913960 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-07ec9104-a329-4b5e-8d16-8817760c6180 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:58.921896 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-07ec9104-a329-4b5e-8d16-8817760c6180 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012289 Aug 02 08:47:58.922476 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Tue Aug 2 08:47:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:47:58.934152 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:58.941906 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011340 Aug 02 08:47:58.942441 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Tue Aug 2 08:47:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:47:58.954842 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a8c44b1f-160a-482a-9864-243ac4d61ef4 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:47:58.963161 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a8c44b1f-160a-482a-9864-243ac4d61ef4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012399 Aug 02 08:47:58.963725 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Tue Aug 2 08:47:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:51:28.660244 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:51:28.661398 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Aug 02 08:51:28.661802 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:51:28.803243 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_api:SELECT=6 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:28.966711 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-52ceeb09-e31c-45bc-82ac-c7397065910e admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:51:28.969140 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:51:28.969140 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: warnings.warn(msg) Aug 02 08:51:28.970363 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-52ceeb09-e31c-45bc-82ac-c7397065910e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:51:28.970963 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-52ceeb09-e31c-45bc-82ac-c7397065910e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:51:28.971750 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-52ceeb09-e31c-45bc-82ac-c7397065910e admin admin] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:51:28.972212 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-52ceeb09-e31c-45bc-82ac-c7397065910e admin admin] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:51:29.006294 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-52ceeb09-e31c-45bc-82ac-c7397065910e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.204571 Aug 02 08:51:29.006858 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 2 08:51:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:51:29.840750 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:51:29.841765 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 02 08:51:29.842162 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:51:30.032366 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-b52c630e-e220-493d-9aeb-13077ca117a0 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:51:30.034817 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:51:30.034817 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: warnings.warn(msg) Aug 02 08:51:30.036017 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-b52c630e-e220-493d-9aeb-13077ca117a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:51:30.036496 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-b52c630e-e220-493d-9aeb-13077ca117a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:51:30.037297 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-b52c630e-e220-493d-9aeb-13077ca117a0 admin admin] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:51:30.037735 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-b52c630e-e220-493d-9aeb-13077ca117a0 admin admin] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:51:30.057485 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-b52c630e-e220-493d-9aeb-13077ca117a0 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077129 Aug 02 08:51:30.057982 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 2 08:51:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:51:41.274876 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:51:41.275884 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 02 08:51:41.276313 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:51:41.419179 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_cell0:SELECT=4 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:41.419898 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_cell1:SELECT=4 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:41.420595 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG dbcounter [-] [103205] Writing DB stats nova_api:SELECT=8 {{(pid=103205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:51:41.468410 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-77bb0d6c-d052-45f8-baee-f7d2b74b445f admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:51:41.470837 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:51:41.470837 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: warnings.warn(msg) Aug 02 08:51:41.472022 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-77bb0d6c-d052-45f8-baee-f7d2b74b445f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:51:41.472522 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-77bb0d6c-d052-45f8-baee-f7d2b74b445f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:51:41.473312 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-77bb0d6c-d052-45f8-baee-f7d2b74b445f admin admin] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:51:41.473746 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-77bb0d6c-d052-45f8-baee-f7d2b74b445f admin admin] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:51:41.498704 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-77bb0d6c-d052-45f8-baee-f7d2b74b445f admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083951 Aug 02 08:51:41.499189 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 2 08:51:41 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:51:42.335712 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:51:42.336775 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-ac6972e7-7398-4dc1-a9b8-305d757c5f49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 02 08:51:42.337179 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 2 08:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:51:42.533568 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-c113cb3f-0b48-4f37-8f65-ede6d3dd6392 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:51:42.535948 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:51:42.535948 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: warnings.warn(msg) Aug 02 08:51:42.537327 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-c113cb3f-0b48-4f37-8f65-ede6d3dd6392 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:51:42.537772 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-c113cb3f-0b48-4f37-8f65-ede6d3dd6392 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:51:42.538562 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-c113cb3f-0b48-4f37-8f65-ede6d3dd6392 admin admin] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:51:42.538986 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-c113cb3f-0b48-4f37-8f65-ede6d3dd6392 admin admin] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:51:42.560540 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-c113cb3f-0b48-4f37-8f65-ede6d3dd6392 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082082 Aug 02 08:51:42.561035 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 2 08:51:42 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:52:43.072821 dv-cinder-787296-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 08:52:43.073566 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: Tue Aug 2 08:52:43 2022 - graceful shutdown triggered... Aug 02 08:52:43.074161 dv-cinder-787296-14-iscsi devstack@n-api.service[103204]: Gracefully killing worker 1 (pid: 103204)... Aug 02 08:52:43.074665 dv-cinder-787296-14-iscsi devstack@n-api.service[103205]: Gracefully killing worker 2 (pid: 103205)... Aug 02 08:52:44.074586 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: worker 1 buried after 1 seconds Aug 02 08:52:44.075138 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: worker 2 buried after 1 seconds Aug 02 08:52:44.075138 dv-cinder-787296-14-iscsi devstack@n-api.service[103203]: goodbye to uWSGI. Aug 02 08:52:44.076296 dv-cinder-787296-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 02 08:52:44.076848 dv-cinder-787296-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 08:52:44.080235 dv-cinder-787296-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 08:52:44.090872 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 08:52:44 2022] *** Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: nodename: dv-cinder-787296-14-iscsi Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: machine: x86_64 Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: clock source: unix Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: pcre jit disabled Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: detected number of CPU cores: 4 Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: current working directory: / Aug 02 08:52:44.092924 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: detected binary path: /usr/bin/uwsgi-core Aug 02 08:52:44.093690 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: your processes number limit is 47680 Aug 02 08:52:44.093690 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: your memory page size is 4096 bytes Aug 02 08:52:44.093690 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: detected max file descriptor number: 2048 Aug 02 08:52:44.093690 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: lock engine: pthread robust mutexes Aug 02 08:52:44.093690 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: thunder lock: enabled Aug 02 08:52:44.093690 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 08:52:44.093690 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 08:52:44.133528 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: Python main interpreter initialized at 0x555d56fe19c0 Aug 02 08:52:44.133528 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: python threads support enabled Aug 02 08:52:44.133528 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: your server socket listen backlog is limited to 100 connections Aug 02 08:52:44.133528 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: your mercy for graceful operations on workers is 90 seconds Aug 02 08:52:44.133929 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 08:52:44.133929 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: *** Operational MODE: preforking *** Aug 02 08:52:44.134239 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: *** uWSGI is running in multiple interpreter mode *** Aug 02 08:52:44.134239 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: spawned uWSGI master process (pid: 117752) Aug 02 08:52:44.134443 dv-cinder-787296-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 08:52:44.135045 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: spawned uWSGI worker 1 (pid: 117772, cores: 1) Aug 02 08:52:44.135565 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: spawned uWSGI worker 2 (pid: 117773, cores: 1) Aug 02 08:52:44.135857 dv-cinder-787296-14-iscsi devstack@n-api.service[117752]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 08:52:44.802637 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 08:52:44.807452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 08:52:45.991383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:52:45.991383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: from cryptography.utils import int_from_bytes Aug 02 08:52:45.991905 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:52:45.991905 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: from cryptography.utils import int_from_bytes Aug 02 08:52:46.033335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:52:46.033335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: from cryptography.utils import int_from_bytes Aug 02 08:52:46.034307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:52:46.034307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: from cryptography.utils import int_from_bytes Aug 02 08:52:48.469501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:52:48.470129 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:52:48.470329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:52:48.470688 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:52:48.470943 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:52:48.471333 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.471658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.471980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.472326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.472654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.472963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.473285 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.473601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.473925 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.474183 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.474498 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.474831 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-14-iscsi {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.475142 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.475621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.475928 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.476277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.476588 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.476911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.477231 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.477733 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.478174 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.478483 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.478793 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.479130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.479442 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.479751 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.480164 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.480432 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.480771 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.481081 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.481972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-14-iscsi {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.481972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.482203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.482410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.482822 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.483113 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.483441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.483740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.484059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.484408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.484726 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.488330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.488330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.488330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.488330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.488330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.488330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.488330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.488330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.489084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.489084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.489084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.489281 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:52:48.489689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.489776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:52:48.489865 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.489945 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:52:48.490023 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.490391 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.490522 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:52:48.490611 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.490685 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:52:48.490756 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.490832 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.491046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.491155 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.491322 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.491475 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.491634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.491783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.491951 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.492142 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.492255 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.492462 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.492580 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.492778 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.492876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.493101 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.493204 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.493415 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.493524 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.493683 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.493785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.493989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.494149 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.494302 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-14-iscsi {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.494459 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.494614 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.494768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.494923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.495068 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.495326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.495490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.495646 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.495804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.495958 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.496112 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.496399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.496559 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.496740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.496891 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.497059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.497213 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.497366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.497563 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.497720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.497866 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.498018 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.498163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.498314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.498535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.498691 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.498838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.498983 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.499139 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.499309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.499455 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.499608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.499763 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.499920 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.500074 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.500261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.500416 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.500561 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.500707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.500851 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-14-iscsi {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.501079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.501731 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.502300 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.502466 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.502624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.502799 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.502956 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.503127 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.503367 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.503519 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.503663 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.503817 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.503980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.504191 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.504367 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.504514 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.504667 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.504822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.504975 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.505126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.505271 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.505549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.505713 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.505876 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.506025 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.506178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.506370 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.506543 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.506689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.506844 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.506997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.507150 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.507304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.507456 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.507601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.507760 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.507906 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.508059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.508250 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.508405 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.508561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.508706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.508851 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.509009 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.509163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.509309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.509460 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.509613 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.509762 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.509917 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.510064 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.510218 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.510375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.510520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.510701 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.510857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.511020 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.511171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.511324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.511477 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.511635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.511782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.511926 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.512493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.512662 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.512817 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.512972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.513125 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.513277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.513523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.513674 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.513835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.513999 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.514156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.514311 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.514508 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.514666 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.514666 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.514976 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.515121 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.515267 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.515412 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.515575 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.515845 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.516048 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.516233 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.516381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.516526 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.516671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.516830 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.516993 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.517140 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.517294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.517440 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.517592 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.517746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.517892 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.518037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.518190 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.518396 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.518565 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.518718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.518881 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.519027 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.519181 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.519370 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.519535 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.519683 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.519835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.519987 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.520200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.520200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.520504 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.520650 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.520803 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.520965 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.521115 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.521266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.521421 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.521566 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.521712 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.521857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.522001 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.522177 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.522712 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.522881 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.523035 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.523201 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.523347 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.523520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.523751 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.523901 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.524046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.524227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.524376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.524531 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.524676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.524838 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.524994 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.525169 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.525332 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.525491 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.525655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.526057 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.526221 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.526381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.526543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.526689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.526841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.526994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.527139 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.527285 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.527444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.527608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.527763 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.527922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.527922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.528244 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.528392 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.528546 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.528693 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.528919 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.529079 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.529232 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.529386 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.529541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.529706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.529865 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.530013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.530159 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.530319 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.530472 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.530625 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.530779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.530931 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.531082 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.531228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.531372 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.531542 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.531703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.531856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.532010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.532219 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.533218 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.533384 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.533532 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.533691 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.533947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.534106 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.534253 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.534405 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.534571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.534719 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.534872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.535017 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.535162 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.535316 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.535476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.535622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.535773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.535919 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.536089 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.536353 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.536517 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.536675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.536828 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.536994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.537154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.537309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.537498 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.537671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:52:48.537824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.537984 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.538131 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.538285 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.538441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.538586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.538750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.538904 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.539049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.539208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.539356 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.539502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.539654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.539801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.539946 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.540107 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.540295 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.540487 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.540738 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.540908 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.541068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.541216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.541369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.541522 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.541677 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.541872 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.542032 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.542185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.542456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.542456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.542775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.542957 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.543518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.543675 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.543820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.544066 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.544270 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.544420 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.544674 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.544835 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.544982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.545127 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.545272 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.545426 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.545593 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.545750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.545896 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.546041 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.546200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.546515 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.546677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.546825 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.546970 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.547124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.547269 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.547429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.547619 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.547811 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.548645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.548805 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.549015 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.549176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.549322 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.549475 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.549630 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.549783 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.549938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.550085 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.550230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.550435 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.550597 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.550744 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.550898 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.551053 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.551203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.551348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.551503 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.551657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.551812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.551966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.552293 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.552549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.552549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.553021 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.553703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.555116 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.555334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.555490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.555490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.555791 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.555955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.556107 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.556279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.556425 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.556592 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.556890 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.557043 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.557191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.557336 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.557493 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.557640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.557942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.558110 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.558267 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.558414 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.558559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.558704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.558861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.559033 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.559181 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.559325 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.559506 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.559755 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.560018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.560382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.560627 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.560627 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.561078 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.561450 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.561697 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.561972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.562216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.562472 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.562708 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.562936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.563099 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.563246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.563400 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.563400 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564392 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564546 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564693 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.564852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.565831 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.565978 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.566173 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.566324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.566494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.566642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.566642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.567092 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.567257 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.567404 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.567773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.567936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.568099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.568307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.568471 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.568632 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.568785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.568936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.569098 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.569251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.569432 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.569595 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.569756 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.569917 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570070 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570231 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570385 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570666 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.570872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.572668 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.572829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.572982 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.572982 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.573278 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.573429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.573429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.573750 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.574246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.574246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.574725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.574884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.574884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.575192 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.575476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.575476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.575771 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.575923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.575923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.576259 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.576421 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.576582 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.576748 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.576748 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.577056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.577211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.577211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.577498 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.577668 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.577668 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.578133 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.578297 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.578460 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.578660 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.578660 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.578985 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.579161 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.579161 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.579473 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.579625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.579625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.579923 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.580077 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.580275 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.580431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.580431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.580720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.580881 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.580881 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.581203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.581356 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.581507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.581658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.581658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.581955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.582118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.582278 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.582431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.582431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.582977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.583154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.583154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.583453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.583606 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.583772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.584350 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.584350 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.584664 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.584968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.585137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.585302 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.585302 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.585727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.585901 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.586061 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.586212 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.586212 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.586557 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.586725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.586878 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.587037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.587037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.587350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.587511 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.587663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.587824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.587824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.588310 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.588482 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.588482 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.588781 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.588942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.588942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.589240 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.589426 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.589589 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.589750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.589750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.590066 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.590237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.590237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.590528 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.590694 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.590855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.591015 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.591015 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.591315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.591476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.591476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.591793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.591947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.592182 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.592344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.592344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.592673 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.592968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.592968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.593273 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.593433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.593433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.593821 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.593977 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.594268 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.594720 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.594720 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.596008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.596642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.596867 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.597030 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.597030 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.597395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.597676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.597676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.598317 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.598611 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.598770 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.598931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.598931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.599311 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.599465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.599465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.599799 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.599981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.600168 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.600357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.600357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.600671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.600823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.600997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.600997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.601309 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.601477 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.601635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.601635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.601941 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.601941 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.602230 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.602230 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.602529 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.602690 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.602856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.603009 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.603009 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.603325 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.603493 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.603493 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.603792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.603973 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.604161 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.604438 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.604438 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.604980 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.605135 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.605135 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.605441 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.605626 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.605905 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.606079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.606079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.606404 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.606656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.606814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.606966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.606966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.607266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.607426 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.607426 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.607716 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.607888 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.608050 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.608239 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.608239 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.608538 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.608829 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.608829 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.609139 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.609292 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.609454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.609608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.609608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.609918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.610091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.610091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.610421 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.611089 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.611255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.611422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.611422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.611740 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.611903 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.612085 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.612266 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.612437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.612597 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.612763 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.612925 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.613079 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.613246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.613399 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.613559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.613713 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.613873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.614028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.614190 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.614350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.614643 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.615040 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.615212 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.615365 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.615365 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.615691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.615691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.616239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.616404 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.616404 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.616832 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.616992 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.617153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.617315 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.617315 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.617634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.617788 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.617788 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.618085 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.618238 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.618398 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.618561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.618561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.618876 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.619170 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.619328 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.619480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.619480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.619818 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.620617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.620617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.620938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.621091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.621260 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.621422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.621422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.621716 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.621869 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.622037 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.622199 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.622199 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.622510 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.622665 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.622665 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.622963 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.623117 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.623269 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.623422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.623422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.623723 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.623925 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.624080 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.624282 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.624439 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.624610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.624863 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.625241 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.625402 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.625557 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.625709 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.626355 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.626626 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.626910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.627312 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.627572 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.627572 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.628080 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.628383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.628383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.628873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.629124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.629580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.629838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.630099 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.630358 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.630630 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.630838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.630838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.631148 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.631318 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.631318 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.631663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.631838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.631838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.632260 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.632426 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.632586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.632748 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.632918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.633104 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.633544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.633708 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.633708 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.634028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.634193 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.634193 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.634494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.634647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.634808 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.635096 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.635096 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.635641 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.635796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.635970 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.636256 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.636256 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.637014 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.637171 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.637171 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.637586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.637770 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.637936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.638091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.638255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.638409 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.638561 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.638726 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.638893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.639048 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.639209 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.639362 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.639541 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.639824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.639991 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.640173 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.640346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.640507 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.640660 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.640822 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.640987 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.641194 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.641381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.641578 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.641838 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.642172 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.642440 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.642872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.643118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.643346 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.643346 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.643804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.644049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.644049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.644550 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.644838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.644838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.645877 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.646045 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.646197 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.646399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.646399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.646767 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.646944 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.647136 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.647327 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.647327 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.647984 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.648240 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.648433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.648624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.648624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.649002 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.649193 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.649193 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.649540 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.649734 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.650100 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.650264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.650264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.650558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.650731 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.650901 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.651054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.651215 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.651387 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.651387 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.651705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.651842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.651963 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.652084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.652253 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.652380 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.652494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.652607 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.652728 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.652842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.652964 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653680 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.653795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.654503 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.654656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.654656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.654966 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.655120 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.655302 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.655556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.655556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.655996 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.656188 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.656358 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.656522 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.656677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.656839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.656993 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.657146 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.658226 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.658401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.658557 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.658712 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.658886 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.659052 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.659215 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.659376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.659537 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.659698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.659698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.659989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.660308 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.660470 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.660623 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.660623 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.660921 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.661087 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.661087 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.661397 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.661556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.661717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.661876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.661876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.662187 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.662339 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.662500 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.662653 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.662805 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.662982 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.663136 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.663298 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.663298 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.663596 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.663596 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.663920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.663920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.664255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.664255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.664556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.664710 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.664871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.665046 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.665201 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.665355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.665506 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.665781 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.665964 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.666215 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.666376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.666538 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.666720 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.666889 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.667049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.667211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.667384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.667537 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.667696 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.667859 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.668048 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.668554 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.668715 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.668878 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.669039 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.669200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.669353 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.669508 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.669661 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.669838 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.669992 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.670152 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.670333 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.670605 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.670765 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.671014 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.671014 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.671347 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.671347 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.671650 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.671817 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.671989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.671989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.672319 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.672483 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.672637 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.672799 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.673020 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.673685 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.673839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.674001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.674161 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.674327 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.674480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.674644 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.674806 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.674968 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.675121 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.675283 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.675444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.675599 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.675881 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.676045 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.676320 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.676491 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.676646 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.676821 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.676984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.677146 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.677313 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.677474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.677627 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.677878 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.678046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.678204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.678390 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.678749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.678915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.679090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.679245 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.679408 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.679562 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.679723 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.679877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.680032 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.680210 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.680385 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.680547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.680823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.680823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.681141 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.681310 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.681475 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.681636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.681789 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.681952 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.682116 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.682279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.682433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.682585 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.682745 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.682898 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.683050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.683224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.683385 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.683539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.683797 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.684071 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.684286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.684460 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.684614 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.684773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.684934 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.685088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.685088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.685457 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.685624 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.685777 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.685946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.686201 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.686481 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.686651 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.686805 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.686966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.687128 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.687281 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.687448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.687601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.687763 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.687928 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.688089 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.688276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.688276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.688833 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.688995 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.689158 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.689320 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.689474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.689641 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.689796 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.689958 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.690111 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.690276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.690439 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.690601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.690754 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.691032 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.691200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.691363 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.691529 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.691529 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.691828 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.691987 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.692208 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.692396 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.692562 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.692724 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.692877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.693030 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.693191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.693352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.693525 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.693679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.693832 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.693985 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.694147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.694311 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.694476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.694476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.694767 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.694930 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.695090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.695254 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.695407 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.695559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.695712 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.695864 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.696024 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.696218 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.696497 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.696773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.696941 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.697095 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.697247 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.697413 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.697568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.697728 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.697883 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.698045 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.698208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.698370 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.698531 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.698722 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.699102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.699264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.699430 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.699586 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.699747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.699912 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.700066 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.700317 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.700557 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.700721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.700721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.701043 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.701350 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.701512 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.701680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.701845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.702009 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.702181 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.702335 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.702504 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.702659 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.702812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.702965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.703119 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.703280 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.703461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.703616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.703777 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.703939 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.704102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.704320 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.704491 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.704645 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.704798 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.704951 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.705113 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.705113 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.705418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.705601 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.705755 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.705907 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.706059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.706227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.706382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.706651 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.706931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.707093 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.707297 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.707474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.707474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.708016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.708207 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.708381 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.708536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.708699 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.708853 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.709035 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.709429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.709595 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.709750 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.709917 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.710071 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.710234 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.710406 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.710767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.710945 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.711112 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.711275 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.711564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.711740 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.711903 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.712076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.712286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.712452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.712608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.712768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.712940 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.713108 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.713262 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.713262 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.713571 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.713725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.714385 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.714560 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.714723 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.714886 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.715040 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.715201 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.715380 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.715544 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.715699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.715852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.716013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.716223 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.716518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.717511 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.717689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.717689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.718003 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.718170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.718332 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.718485 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.718647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.718813 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.718974 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.719136 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.719543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.719715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.720454 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.720612 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.720765 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.720919 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.721085 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.721249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.721411 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.721590 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.722016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.722180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.722334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.722503 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.722658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.722811 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.722965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.723126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.723126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.723439 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.723439 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.723730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.723882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.724045 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.724282 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.724460 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.724624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.724857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.725057 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.725215 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.725384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.725559 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.725713 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.725875 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.726036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.726218 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.726504 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.726679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.726965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.727126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.727280 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.727456 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.727456 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.727876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.728042 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.728221 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.728379 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.728545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.728710 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.728871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.728871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.729170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.729574 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.730547 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.730722 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.730865 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.731745 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.731745 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.732325 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.732716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.732890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.733055 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.733208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.733362 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.733532 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.733696 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.733851 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.734004 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.734170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.734324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.734492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.734648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.734853 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.735016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.735172 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.735342 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.736048 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.736234 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.736389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.736553 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.736721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.737020 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.737295 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.737462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.737626 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.737914 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.738075 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.738251 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.738407 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.738796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.739004 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.739113 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.739205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.739364 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.739484 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.739598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.739675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.739786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740047 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740223 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740324 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740400 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740488 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740646 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740739 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740815 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740887 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.740979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.741066 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.741147 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.741247 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.741328 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.741449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.741539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.741623 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.741699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.742021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.742219 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.742536 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.742718 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.743037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.743236 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.743403 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.743567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.743739 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.743918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.744081 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.744262 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.744417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.744583 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.744751 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.744915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.745070 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.745070 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.745380 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.745535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.745688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.745852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.746025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.746286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.746453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.746629 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.746791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.747129 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.747321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.747594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.747761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.747943 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.748248 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.748359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.748449 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.748536 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.748632 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.748780 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.748930 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749176 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749279 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749464 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749464 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749871 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.749965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.750228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.750375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.750510 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.750642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.750774 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.750906 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751074 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751213 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751317 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751406 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751586 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751683 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751828 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751921 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.751996 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752168 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752387 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752588 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752771 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.752969 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753202 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753202 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:52:48.753390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.753390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.754705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.755995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.756642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.756642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.756642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.756642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.756642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.756642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.756642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.756642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757906 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757906 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757906 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757906 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.757906 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.758608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.758608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.758856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.759176 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.759493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.759808 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.760269 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.760461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.760784 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.761120 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.761439 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.761750 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.762184 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.762503 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.762829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.763158 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.763477 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.763801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.764136 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.764469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.764801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.765115 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.765451 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.765803 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.766144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.766560 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.766906 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.767220 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.767531 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.767848 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.768211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.768534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.768845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.769154 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.769468 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.769778 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.770136 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.770403 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.770710 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.771023 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.771364 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.771636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.771944 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.774422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.774769 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.775227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.775564 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.775895 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.776272 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.776600 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.776927 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.777245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.777814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.778001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.778261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.778691 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.778925 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.779262 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.779584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.779918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.780281 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.780622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.780945 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.781291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.781611 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.781995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.782753 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.783095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.783435 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.783934 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.784092 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.784417 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.784732 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.785069 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.785397 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.785726 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.786048 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.786367 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.786708 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.787027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.787347 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.787665 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.787986 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.788330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.788656 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.788977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.789295 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.789622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.789943 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.790278 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.790737 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.790981 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.791311 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.791645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.792005 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.792383 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.792738 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.793073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.793396 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.793717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.794028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:52:48.794277 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:52:48.802953 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO dbcounter [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Registered counter for database nova_api Aug 02 08:52:48.824274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_db.sqlalchemy.engines [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:52:48.831528 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writer thread running {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:52:48.856520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO dbcounter [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Registered counter for database nova_api Aug 02 08:52:48.877464 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_db.sqlalchemy.engines [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:52:48.884648 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writer thread running {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:52:48.889611 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.context [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58122f4c-a1ac-4fa0-ab3e-697d06b208ce(cell1) {{(pid=117773) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 08:52:48.894378 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:52:48.897046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:52:48.897868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:52:48.900001 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:52:48.902049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO dbcounter [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Registered counter for database nova_cell0 Aug 02 08:52:48.906240 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO dbcounter [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Registered counter for database nova_cell1 Aug 02 08:52:48.914862 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_db.sqlalchemy.engines [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:52:48.916920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_db.sqlalchemy.engines [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:52:48.923291 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writer thread running {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:52:48.924681 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writer thread running {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:52:48.957502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.context [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58122f4c-a1ac-4fa0-ab3e-697d06b208ce(cell1) {{(pid=117772) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 08:52:48.962179 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:52:48.964978 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:52:48.965787 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:52:48.967819 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:52:48.970421 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO dbcounter [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Registered counter for database nova_cell0 Aug 02 08:52:48.974613 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO dbcounter [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Registered counter for database nova_cell1 Aug 02 08:52:48.982940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_db.sqlalchemy.engines [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:52:48.985244 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_db.sqlalchemy.engines [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:52:48.989880 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writer thread running {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:52:48.995651 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writer thread running {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:52:49.075307 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO dbcounter [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Registered counter for database nova_cell0 Aug 02 08:52:49.083166 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_db.sqlalchemy.engines [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:52:49.087624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writer thread running {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:52:49.140265 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO dbcounter [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Registered counter for database nova_cell0 Aug 02 08:52:49.147899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_db.sqlalchemy.engines [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:52:49.153279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writer thread running {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:52:49.410482 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: WARNING keystonemiddleware.auth_token [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:52:49.418326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: WARNING keystonemiddleware.auth_token [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:52:49.471800 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: WARNING keystonemiddleware.auth_token [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:52:49.479271 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: WARNING keystonemiddleware.auth_token [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:52:49.769583 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: WARNING keystonemiddleware.auth_token [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:52:49.776417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: WARNING keystonemiddleware.auth_token [None req-526aabec-9999-429d-bdbc-603c20b378e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:52:49.782176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d56fe19c0 pid: 117773 (default app) Aug 02 08:52:49.830772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: WARNING keystonemiddleware.auth_token [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:52:49.837175 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: WARNING keystonemiddleware.auth_token [None req-7f4ab8d7-cc70-4051-9f4b-94ea630fca4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:52:49.842911 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d56fe19c0 pid: 117772 (default app) Aug 02 08:53:32.461286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:32.462649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:32.463552 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:32.466517 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:34.811836 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ce650945-02dd-4993-9ea7-2b985a3304fc tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Action: 'create', calling method: .version_select at 0x7f1400aadf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-880927388"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:36.090387 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ce650945-02dd-4993-9ea7-2b985a3304fc tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.646139 Aug 02 08:53:36.092753 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Aug 2 08:53:32 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3650 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 08:53:36.111556 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:36.119955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:36.123457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:36.126144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:53:36.588022 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-08ea4f5a-dfb7-45ea-8614-642d432336cd tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f1400b20c10>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:36.801154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-bc04dcff-764e-47cd-9cbc-ae95b838c1a0 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f140092ddc0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:36.893309 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-bc04dcff-764e-47cd-9cbc-ae95b838c1a0 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3909a9bc-41b6-4fc1-b71e-47c4f2e8f5c5" status: 200 len: 351 microversion: 2.1 time: 0.097477 Aug 02 08:53:36.893944 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 2/2] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 08:53:36 2022] GET /compute/v2.1/os-volumes/3909a9bc-41b6-4fc1-b71e-47c4f2e8f5c5 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:53:37.209457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-08ea4f5a-dfb7-45ea-8614-642d432336cd tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82" status: 200 len: 345 microversion: 2.1 time: 1.104626 Aug 02 08:53:37.210494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 1/3] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 08:53:36 2022] GET /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82 => generated 345 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:37.224574 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cb0ad2b4-beb2-4ba1-86a2-2415d935e8e5 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Action: 'create', calling method: .version_select at 0x7f140093c4c0>, body: {"snapshot": {"volume_id": "e2dba281-7239-4e7e-8cb1-c6d0ac341a82", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-411962541"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:37.983621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-cb0ad2b4-beb2-4ba1-86a2-2415d935e8e5 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.764657 Aug 02 08:53:37.985569 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 3/4] 10.222.0.17 () {60 vars in 1162 bytes} [Tue Aug 2 08:53:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:37.999092 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7ae1504f-dc8f-4084-bc07-9b75ce40496c tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f1400968d30>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:38.416607 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7ae1504f-dc8f-4084-bc07-9b75ce40496c tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 286 microversion: 2.1 time: 0.418551 Aug 02 08:53:38.424857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 2/5] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:37 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 286 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:38.428571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f72e2b5c-8f3a-467c-8bdc-30f2e0d15d07 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f1400945550>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:38.502578 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f72e2b5c-8f3a-467c-8bdc-30f2e0d15d07 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.078143 Aug 02 08:53:38.503455 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 4/6] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Aug 2 08:53:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:38.520548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-96af655e-6b3c-4e27-9037-032824b7526d tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f14009284c0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:38.585468 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-96af655e-6b3c-4e27-9037-032824b7526d tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 286 microversion: 2.1 time: 0.068716 Aug 02 08:53:38.586730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 3/7] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:38 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:38.751721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5d01c463-aa9b-42a7-a0dd-537b96a18e95 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f140093c310>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:38.854217 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5d01c463-aa9b-42a7-a0dd-537b96a18e95 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6ba84cac-7478-4bc8-a089-2ce8715d35a8" status: 200 len: 350 microversion: 2.1 time: 0.108265 Aug 02 08:53:38.854855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 08:53:38 2022] GET /compute/v2.1/os-volumes/6ba84cac-7478-4bc8-a089-2ce8715d35a8 => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:53:39.441703 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e8d54d9d-c7af-4b05-b69d-1a3ca7cf716c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'create', calling method: .version_select at 0x7f1400968ee0>, body: {"keypair": {"name": "tempest-keypair-1018435939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNh2PE+dbs2OBb5P+GnAbyGxGj/ptzgUVMoi2HGcnvy8uOQXBWgBFfp/ac08sW+seOnYVSktqVFDCoj/AdyVFm3F7epx6f83kySbq8NFddc8bBcxmOTt0nMgOGZobFu9g=="}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:39.551285 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-e8d54d9d-c7af-4b05-b69d-1a3ca7cf716c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Getting quotas for project 1cb1f802c78a4317a0af32afb533eb8a. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:53:39.570006 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-e8d54d9d-c7af-4b05-b69d-1a3ca7cf716c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Getting quotas for user e846d960fa87451db8ae291e22b3cb7b and project 1cb1f802c78a4317a0af32afb533eb8a. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:53:39.603384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-97a22971-ea50-4097-8454-48445b54b0fb tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f140092db80>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:39.653915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-97a22971-ea50-4097-8454-48445b54b0fb tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 286 microversion: 2.1 time: 0.055432 Aug 02 08:53:39.660029 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 6/9] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:39 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:39.692276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e8d54d9d-c7af-4b05-b69d-1a3ca7cf716c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.345336 Aug 02 08:53:39.692883 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 4/10] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Aug 2 08:53:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 347 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 08:53:40.667759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-280157f9-aaab-4f1d-9fbf-8aee2b506298 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f1400945af0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:40.744270 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-280157f9-aaab-4f1d-9fbf-8aee2b506298 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 286 microversion: 2.1 time: 0.081136 Aug 02 08:53:40.745148 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 7/11] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:40 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:41.757686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-af2b44b6-43fa-4c6e-a65e-16754cb9fe74 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f14000d0430>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:41.819416 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-af2b44b6-43fa-4c6e-a65e-16754cb9fe74 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 286 microversion: 2.1 time: 0.065905 Aug 02 08:53:41.820683 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 5/12] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:41 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:42.834429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a59b8069-3e68-4264-a0a2-09d0d51e5bcf tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f140093c310>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:42.891509 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a59b8069-3e68-4264-a0a2-09d0d51e5bcf tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 286 microversion: 2.1 time: 0.061157 Aug 02 08:53:42.892353 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 8/13] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:42 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:43.908213 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fb77df4e-8f6f-496f-82a8-15e3c5a9f1b2 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f14000d0af0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:43.992157 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fb77df4e-8f6f-496f-82a8-15e3c5a9f1b2 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 286 microversion: 2.1 time: 0.091291 Aug 02 08:53:43.992850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 6/14] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:43 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:44.535205 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-389983965", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e28baa36-2ada-4198-89c4-451b2f06a562"}], "security_groups": [{"name": "tempest-securitygroup--1927481105"}], "key_name": "tempest-keypair-1018435939", "user_data": "}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:44.915214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] validate_networks() for [('e28baa36-2ada-4198-89c4-451b2f06a562', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:53:45.006661 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7d181f6c-6b79-4489-ac63-b7135bc7c4c3 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f1400912ee0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:45.056685 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7d181f6c-6b79-4489-ac63-b7135bc7c4c3 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 286 microversion: 2.1 time: 0.054529 Aug 02 08:53:45.057614 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 7/15] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:45 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:45.879355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1371386761", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:46.231461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] validate_networks() for [('30dcf16f-3811-475b-b954-f6d604e51a35', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:53:47.771700 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:53:47.772450 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:53:47.772797 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:53:47.773487 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:53:47.774034 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:53:47.815117 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:47.819764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:47.820854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:47.825737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:47.932526 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Getting quotas for project 1cb1f802c78a4317a0af32afb533eb8a. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:53:47.965157 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Getting quotas for user e846d960fa87451db8ae291e22b3cb7b and project 1cb1f802c78a4317a0af32afb533eb8a. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:53:47.995465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:53:48.016583 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:53:48.311008 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7cb46011-9be5-46b6-92b2-d62771f6a693 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.786323 Aug 02 08:53:48.313506 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 9/16] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Aug 2 08:53:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 3789 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 08:53:48.323606 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-29faad3f-c227-435f-8a15-f964a4158af6 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f13fbfc5310>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:48.420458 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-29faad3f-c227-435f-8a15-f964a4158af6 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 200 len: 287 microversion: 2.1 time: 0.105256 Aug 02 08:53:48.423334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 10/17] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:48 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:48.430830 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5971bcd3-58da-4fc1-bc3a-5bb3182a08d8 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f13fbfc5670>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:48.562122 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5971bcd3-58da-4fc1-bc3a-5bb3182a08d8 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b333c94c-dcda-4888-a95f-11847aa3f847" status: 200 len: 350 microversion: 2.1 time: 0.137110 Aug 02 08:53:48.563261 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 11/18] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 08:53:48 2022] GET /compute/v2.1/os-volumes/b333c94c-dcda-4888-a95f-11847aa3f847 => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:48.826636 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ee574959-cb5e-4c3c-8eb7-aff122c31364 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'create', calling method: .version_select at 0x7f13fbfc5790>, body: {"keypair": {"name": "tempest-keypair-1857626531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAkf68WOhla7UudU418XxtOFFy767tYlnVhJjEfBK5ReB3h3DZwPcmH0p8AAdck51i9zyJnobpm+SL5IDhOG6zrRvY8jYr8HGDmaNySLoWe3XAdNTwhnEkbT48pZrZFCg=="}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:48.870428 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:53:48.870999 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:53:48.871754 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:53:48.872405 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:53:48.873061 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:53:48.875823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-ee574959-cb5e-4c3c-8eb7-aff122c31364 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Getting quotas for project 7f068d1fec9a4e55b60cd782cf4ecf89. Resources: {'key_pairs'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:53:48.881373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-ee574959-cb5e-4c3c-8eb7-aff122c31364 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Getting quotas for user 2b15c4ba64ca4097a4cdb653fdb94d78 and project 7f068d1fec9a4e55b60cd782cf4ecf89. Resources: {'key_pairs'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:53:48.895077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:48.896767 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:48.897840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:48.898602 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:48.938948 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Getting quotas for project a4c886ec53c84d5d9542ab7dbbdfcf8b. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:53:48.943551 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Getting quotas for user 7ed1be3a1ae249828caa8b88fd606557 and project a4c886ec53c84d5d9542ab7dbbdfcf8b. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:53:48.943813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ee574959-cb5e-4c3c-8eb7-aff122c31364 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.377420 Aug 02 08:53:48.946672 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 12/19] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 08:53:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:48.975966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f016e82b-7f48-4c35-8bf2-5cfd12de95f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:48.976664 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f016e82b-7f48-4c35-8bf2-5cfd12de95f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:48.983053 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:53:48.988400 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:53:49.154301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-bc930ba8-972e-49d3-a563-0d560510bbb0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.387198 Aug 02 08:53:49.157517 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 8/20] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:53:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 3392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:53:49.192389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8a901613-6002-4413-bfa2-803e58b3bc3e tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f13fbfd91f0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:49.198525 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f016e82b-7f48-4c35-8bf2-5cfd12de95f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:49.247989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f016e82b-7f48-4c35-8bf2-5cfd12de95f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:49.254644 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f016e82b-7f48-4c35-8bf2-5cfd12de95f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:49.257252 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f016e82b-7f48-4c35-8bf2-5cfd12de95f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1281 microversion: 2.20 time: 0.309217 Aug 02 08:53:49.262440 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 13/21] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:53:48 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1281 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:53:49.283184 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-bf9ec94c-053f-4a98-8a12-d9aaee22f62d tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f13faf89310>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:49.387256 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8a901613-6002-4413-bfa2-803e58b3bc3e tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 202 len: 0 microversion: 2.1 time: 0.227795 Aug 02 08:53:49.388276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 9/22] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Aug 2 08:53:49 2022] DELETE /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:53:49.545735 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-bf9ec94c-053f-4a98-8a12-d9aaee22f62d tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.281474 Aug 02 08:53:49.546318 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 14/23] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Aug 2 08:53:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:49.551767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3a7f8246-3acb-472d-b780-4109dd2c3098 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:49.552661 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3a7f8246-3acb-472d-b780-4109dd2c3098 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:49.903175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3a7f8246-3acb-472d-b780-4109dd2c3098 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:49.910403 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-435024350", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "networks": [{"uuid": "fb125714-20fe-43c3-9c3f-9d3ae840f2f3"}]}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:49.916826 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3a7f8246-3acb-472d-b780-4109dd2c3098 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1222 microversion: 2.1 time: 0.364628 Aug 02 08:53:49.917487 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 15/24] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:49 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1222 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:49.932408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7d783fd1-2a3e-439c-8582-67826346ba36 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f13faf89430>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:50.084380 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] validate_networks() for [('fb125714-20fe-43c3-9c3f-9d3ae840f2f3', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:53:50.117709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-7d783fd1-2a3e-439c-8582-67826346ba36 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] HTTP exception thrown: Snapshot 49ac90d5-ef6c-42a6-ab21-98444082e22e could not be found. Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7d783fd1-2a3e-439c-8582-67826346ba36 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Request method failure captured: Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e HTTP/1.1 Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYMSo6O32Xe6mlKk0NGqRouZ3S27h0c_byfYyJBQ72ILi0FxZkmeQzD3GTZOQBmgiVg0DwNjQkqPlIjt_Atf-7aHK9vfBs0L4fAOw4zSi6gMLAxpAlGZLGxUFpvnNxqE5fLA8QklNYj3mbSq_WOAFP8tGKHjsKwYzGUtGnjJnDkCic Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 01a4c7b61759414da02f2d103681fb8e Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:53:50.121729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_01a4c7b61759414da02f2d103681fb8e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/01a4c7b61759414da02f2d103681fb8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01a4c7b61759414da02f2d103681fb8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01a4c7b61759414da02f2d103681fb8e"}]}] Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 01a4c7b61759414da02f2d103681fb8e Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-VolumesSnapshotsTestJSON-70937265-project Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: aece0983b10f4b1b833248e2ccf0d7be Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-VolumesSnapshotsTestJSON-70937265-project Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Snapshot 49ac90d5-ef6c-42a6-ab21-98444082e22e could not be found. Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '49ac90d5-ef6c-42a6-ab21-98444082e22e'} Aug 02 08:53:50.123108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 49ac90d5-ef6c-42a6-ab21-98444082e22e could not be found. (HTTP 404) (Request-ID: req-0e52f8bd-a3aa-4f55-9379-aa6a692777b6) Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:50.123989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 08:53:50.125182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 49ac90d5-ef6c-42a6-ab21-98444082e22e could not be found. Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 08:53:50.126480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 49ac90d5-ef6c-42a6-ab21-98444082e22e could not be found. Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 49ac90d5-ef6c-42a6-ab21-98444082e22e could not be found. Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7d783fd1-2a3e-439c-8582-67826346ba36 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Returning 404 to user: Snapshot 49ac90d5-ef6c-42a6-ab21-98444082e22e could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7d783fd1-2a3e-439c-8582-67826346ba36 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e" status: 404 len: 111 microversion: 2.1 time: 0.205591 Aug 02 08:53:50.128220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 16/25] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 2 08:53:49 2022] GET /compute/v2.1/os-snapshots/49ac90d5-ef6c-42a6-ab21-98444082e22e => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:53:50.148936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0f647651-aeb8-44e1-a980-6996f181764a tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f140092dc10>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:50.396424 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0f647651-aeb8-44e1-a980-6996f181764a tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.268641 Aug 02 08:53:50.397374 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 17/26] 10.222.0.17 () {58 vars in 1149 bytes} [Tue Aug 2 08:53:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:50.410279 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ca81d3f3-5fa6-4cf3-9db7-e5f24b434358 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f13faf6e430>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:50.550644 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ca81d3f3-5fa6-4cf3-9db7-e5f24b434358 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82" status: 202 len: 0 microversion: 2.1 time: 0.150188 Aug 02 08:53:50.551823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 18/27] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 08:53:50 2022] DELETE /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:53:50.562260 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1910725620", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:50.723800 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] validate_networks() for [('30dcf16f-3811-475b-b954-f6d604e51a35', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:53:51.137076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:53:51.138136 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:53:51.138858 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:53:51.139825 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:53:51.140494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:53:51.161796 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:51.162363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:51.165982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:51.166517 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:51.264018 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Getting quotas for project e350e1aaf5d446b989d2e6c7ab90e133. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:53:51.273162 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Getting quotas for user e83b16baa6944aa299cd112043306f68 and project e350e1aaf5d446b989d2e6c7ab90e133. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:53:51.331294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:53:51.338251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:53:51.532565 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-dacb8ed9-4759-40ac-af98-d1a37c138e24 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.137084 Aug 02 08:53:51.537960 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 10/28] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:53:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:53:51.556636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:51.559809 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:51.580356 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:51.581735 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:51.582994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:51.584075 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:52.334104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:52.365944 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:53:52.366522 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:53:52.366925 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:53:52.368237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:53:52.368702 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:53:52.383931 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:52.390197 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:52.395535 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-dd984594-4e60-47be-b659-2242bfc84b52 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1285 microversion: 2.20 time: 0.854320 Aug 02 08:53:52.398956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 11/29] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:53:51 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1285 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:53:52.406923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:52.407831 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:52.409339 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:52.409779 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ef611899-187d-42d4-9838-a9565e218cdd tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f13faf4fdc0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:52.409891 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:52.488522 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Getting quotas for project a4c886ec53c84d5d9542ab7dbbdfcf8b. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:53:52.501146 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Getting quotas for user 7ed1be3a1ae249828caa8b88fd606557 and project a4c886ec53c84d5d9542ab7dbbdfcf8b. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:53:52.555345 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:53:52.565444 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ef611899-187d-42d4-9838-a9565e218cdd tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.164898 Aug 02 08:53:52.566769 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:53:52.566913 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 12/30] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Aug 2 08:53:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:52.572956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7f2d49d1-fbbe-4d15-899c-4e91416aad9c tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f13faf24d30>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:52.642768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-7f2d49d1-fbbe-4d15-899c-4e91416aad9c tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] HTTP exception thrown: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7f2d49d1-fbbe-4d15-899c-4e91416aad9c tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Request method failure captured: Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82 HTTP/1.1 Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYMSo6O32Xe6mlKk0NGqRouZ3S27h0c_byfYyJBQ72ILi0FxZkmeQzD3GTZOQBmgiVg0DwNjQkqPlIjt_Atf-7aHK9vfBs0L4fAOw4zSi6gMLAxpAlGZLGxUFpvnNxqE5fLA8QklNYj3mbSq_WOAFP8tGKHjsKwYzGUtGnjJnDkCic Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 01a4c7b61759414da02f2d103681fb8e Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 08:53:52.668736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_01a4c7b61759414da02f2d103681fb8e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/01a4c7b61759414da02f2d103681fb8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01a4c7b61759414da02f2d103681fb8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01a4c7b61759414da02f2d103681fb8e"}]}] Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 01a4c7b61759414da02f2d103681fb8e Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-VolumesSnapshotsTestJSON-70937265-project Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: aece0983b10f4b1b833248e2ccf0d7be Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-70937265-project Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'e2dba281-7239-4e7e-8cb1-c6d0ac341a82'} Aug 02 08:53:52.669823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. (HTTP 404) (Request-ID: req-cfa75592-aa92-4ded-9ddc-85aeea22e5e9) Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:52.670452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 08:53:52.671469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 08:53:52.673321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7f2d49d1-fbbe-4d15-899c-4e91416aad9c tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Returning 404 to user: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:53:52.675715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7f2d49d1-fbbe-4d15-899c-4e91416aad9c tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82" status: 404 len: 109 microversion: 2.1 time: 0.102483 Aug 02 08:53:52.680501 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 13/31] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 08:53:52 2022] GET /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:53:52.708908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c3beaa14-a396-408d-8f32-cb570a355220 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.153803 Aug 02 08:53:52.715667 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 19/32] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:53:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:53:52.720854 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f90e5ed3-2a36-46dd-9319-e71adacde3ae tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:52.723113 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f90e5ed3-2a36-46dd-9319-e71adacde3ae tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:52.730187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-434167a0-2235-4dda-adb3-bffe9bdff406 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f13faf895e0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:52.882909 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f90e5ed3-2a36-46dd-9319-e71adacde3ae tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:52.907079 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f90e5ed3-2a36-46dd-9319-e71adacde3ae tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1214 microversion: 2.1 time: 0.225078 Aug 02 08:53:52.915724 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 14/33] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:52 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1214 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:52.926356 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c18611c2-2026-404e-ac85-7b96c7e593d7 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f140004be50>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:52.988772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-c18611c2-2026-404e-ac85-7b96c7e593d7 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] HTTP exception thrown: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c18611c2-2026-404e-ac85-7b96c7e593d7 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Request method failure captured: Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82 HTTP/1.1 Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYMSo6O32Xe6mlKk0NGqRouZ3S27h0c_byfYyJBQ72ILi0FxZkmeQzD3GTZOQBmgiVg0DwNjQkqPlIjt_Atf-7aHK9vfBs0L4fAOw4zSi6gMLAxpAlGZLGxUFpvnNxqE5fLA8QklNYj3mbSq_WOAFP8tGKHjsKwYzGUtGnjJnDkCic Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 01a4c7b61759414da02f2d103681fb8e Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 08:53:52.992764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_01a4c7b61759414da02f2d103681fb8e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/01a4c7b61759414da02f2d103681fb8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01a4c7b61759414da02f2d103681fb8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01a4c7b61759414da02f2d103681fb8e"}]}] Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 01a4c7b61759414da02f2d103681fb8e Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-VolumesSnapshotsTestJSON-70937265-project Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: aece0983b10f4b1b833248e2ccf0d7be Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-70937265-project Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'e2dba281-7239-4e7e-8cb1-c6d0ac341a82'} Aug 02 08:53:52.994049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. (HTTP 404) (Request-ID: req-47c6ada9-6985-4ad8-bb53-4d0f7622f156) Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:52.994727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 08:53:52.995744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 08:53:52.996686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c18611c2-2026-404e-ac85-7b96c7e593d7 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Returning 404 to user: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:53:52.999013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c18611c2-2026-404e-ac85-7b96c7e593d7 tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82" status: 404 len: 109 microversion: 2.1 time: 0.078931 Aug 02 08:53:53.000721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 15/34] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 08:53:52 2022] DELETE /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:53:53.010418 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-204ee7c1-bbc8-4bed-84ba-0af7124c6711 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:53.010704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-204ee7c1-bbc8-4bed-84ba-0af7124c6711 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:53.070656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-434167a0-2235-4dda-adb3-bffe9bdff406 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.356433 Aug 02 08:53:53.071759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 20/35] 10.222.0.17 () {58 vars in 1167 bytes} [Tue Aug 2 08:53:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:53.078084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8cfb4897-12b2-4639-b0d0-1529abf5d45a tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Calling method '.version_select at 0x7f13faf89790>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:53.135616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-8cfb4897-12b2-4639-b0d0-1529abf5d45a tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] HTTP exception thrown: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8cfb4897-12b2-4639-b0d0-1529abf5d45a tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Request method failure captured: Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82 HTTP/1.1 Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYMSo6O32Xe6mlKk0NGqRouZ3S27h0c_byfYyJBQ72ILi0FxZkmeQzD3GTZOQBmgiVg0DwNjQkqPlIjt_Atf-7aHK9vfBs0L4fAOw4zSi6gMLAxpAlGZLGxUFpvnNxqE5fLA8QklNYj3mbSq_WOAFP8tGKHjsKwYzGUtGnjJnDkCic Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 01a4c7b61759414da02f2d103681fb8e Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:53:53.138981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_01a4c7b61759414da02f2d103681fb8e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/01a4c7b61759414da02f2d103681fb8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01a4c7b61759414da02f2d103681fb8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01a4c7b61759414da02f2d103681fb8e"}]}] Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 01a4c7b61759414da02f2d103681fb8e Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-70937265 Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-VolumesSnapshotsTestJSON-70937265-project Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: aece0983b10f4b1b833248e2ccf0d7be Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-VolumesSnapshotsTestJSON-70937265-project Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'e2dba281-7239-4e7e-8cb1-c6d0ac341a82'} Aug 02 08:53:53.140079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. (HTTP 404) (Request-ID: req-b040bbd5-07cf-4640-bcc2-db0474483994) Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:53.141948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 08:53:53.142861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 08:53:53.145874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. Aug 02 08:53:53.147915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:53:53.151383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8cfb4897-12b2-4639-b0d0-1529abf5d45a tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] Returning 404 to user: Volume e2dba281-7239-4e7e-8cb1-c6d0ac341a82 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:53:53.152556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8cfb4897-12b2-4639-b0d0-1529abf5d45a tempest-VolumesSnapshotsTestJSON-70937265 tempest-VolumesSnapshotsTestJSON-70937265-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82" status: 404 len: 109 microversion: 2.1 time: 0.079518 Aug 02 08:53:53.157666 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 21/36] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 08:53:53 2022] GET /compute/v2.1/os-volumes/e2dba281-7239-4e7e-8cb1-c6d0ac341a82 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:53:53.182626 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9e244fc6-d700-4101-9e12-4cd0219607e2 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f13faf739d0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:53.312522 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-204ee7c1-bbc8-4bed-84ba-0af7124c6711 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:53.331681 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-204ee7c1-bbc8-4bed-84ba-0af7124c6711 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1222 microversion: 2.1 time: 0.327574 Aug 02 08:53:53.361213 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 16/37] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:53 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1222 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:53.427267 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:53.431595 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:53.456563 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:53.458601 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:53.459862 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:53.465346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:53.574862 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9e244fc6-d700-4101-9e12-4cd0219607e2 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.409055 Aug 02 08:53:53.575667 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 22/38] 10.222.0.17 () {58 vars in 1170 bytes} [Tue Aug 2 08:53:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:53.594707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9eb4e46d-1df6-462d-a9b1-e1842840b7a2 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f13faf73d30>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:54.003792 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9eb4e46d-1df6-462d-a9b1-e1842840b7a2 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.413202 Aug 02 08:53:54.004459 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 23/39] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Aug 2 08:53:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:54.016227 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0ef598f4-5c5c-4593-83a5-8b18d6876f29 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:54.016862 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0ef598f4-5c5c-4593-83a5-8b18d6876f29 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:54.030719 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0ef598f4-5c5c-4593-83a5-8b18d6876f29 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:54.051931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0ef598f4-5c5c-4593-83a5-8b18d6876f29 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:54.054562 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0ef598f4-5c5c-4593-83a5-8b18d6876f29 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:54.055040 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0ef598f4-5c5c-4593-83a5-8b18d6876f29 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:54.119809 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:54.161896 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:54.164081 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:54.166107 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e22a7d93-fece-4f86-b03a-d89cbf6c98b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1341 microversion: 2.20 time: 0.746323 Aug 02 08:53:54.180796 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 17/40] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:53:53 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1341 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:53:54.187987 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-df1fdc9e-5318-4eeb-8ed2-656baade6837 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f13faea0c10>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:54.604875 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-df1fdc9e-5318-4eeb-8ed2-656baade6837 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.422845 Aug 02 08:53:54.605400 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0ef598f4-5c5c-4593-83a5-8b18d6876f29 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:54.615757 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 18/41] 10.222.0.17 () {58 vars in 1188 bytes} [Tue Aug 2 08:53:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:53:54.622264 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-35727ea5-a8b2-4093-a5c8-1e5831ab0d4b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:54.623131 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-35727ea5-a8b2-4093-a5c8-1e5831ab0d4b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:54.647764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0ef598f4-5c5c-4593-83a5-8b18d6876f29 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1266 microversion: 2.1 time: 0.639529 Aug 02 08:53:54.663709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 24/42] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:54 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1266 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:54.665487 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35727ea5-a8b2-4093-a5c8-1e5831ab0d4b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:54.666054 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35727ea5-a8b2-4093-a5c8-1e5831ab0d4b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:54.672735 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-178c4278-afd5-4dfd-b55e-85bab12496d7 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] Calling method '.version_select at 0x7f13faf89b80>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:54.684305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35727ea5-a8b2-4093-a5c8-1e5831ab0d4b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:54.688751 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35727ea5-a8b2-4093-a5c8-1e5831ab0d4b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:54.962972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-178c4278-afd5-4dfd-b55e-85bab12496d7 tempest-VolumesTestJSON-1105078867 tempest-VolumesTestJSON-1105078867-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.307462 Aug 02 08:53:54.964046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 25/43] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Aug 2 08:53:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:55.113229 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-35727ea5-a8b2-4093-a5c8-1e5831ab0d4b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:55.125585 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-35727ea5-a8b2-4093-a5c8-1e5831ab0d4b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1226 microversion: 2.1 time: 0.506628 Aug 02 08:53:55.130529 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 19/44] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:54 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1226 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:55.198258 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:55.199143 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:55.214555 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:55.233154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:55.235664 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:55.243145 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:55.522256 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:55.536063 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:55.545663 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:55.548099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9fdd34c4-5434-4c4e-be07-67b0ecbfef63 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1339 microversion: 2.20 time: 0.355999 Aug 02 08:53:55.551168 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 26/45] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:53:55 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:53:55.671204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c754c9c4-a956-461f-89a3-b063aceac4ff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:55.672149 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c754c9c4-a956-461f-89a3-b063aceac4ff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:55.679591 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c754c9c4-a956-461f-89a3-b063aceac4ff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:55.685050 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c754c9c4-a956-461f-89a3-b063aceac4ff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:55.687620 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c754c9c4-a956-461f-89a3-b063aceac4ff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:55.692576 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c754c9c4-a956-461f-89a3-b063aceac4ff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:56.110575 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c754c9c4-a956-461f-89a3-b063aceac4ff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:56.122634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c754c9c4-a956-461f-89a3-b063aceac4ff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1272 microversion: 2.1 time: 0.455519 Aug 02 08:53:56.147255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 20/46] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:55 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1272 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:56.147952 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3fbca6c2-f3f2-4f98-8d96-64a9baf99cb1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:56.148714 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3fbca6c2-f3f2-4f98-8d96-64a9baf99cb1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:56.169711 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3fbca6c2-f3f2-4f98-8d96-64a9baf99cb1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:56.176345 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3fbca6c2-f3f2-4f98-8d96-64a9baf99cb1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:56.177201 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3fbca6c2-f3f2-4f98-8d96-64a9baf99cb1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:56.177662 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3fbca6c2-f3f2-4f98-8d96-64a9baf99cb1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:56.572178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:56.572770 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:56.607037 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:56.613425 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:56.614346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:56.614879 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:56.654908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3fbca6c2-f3f2-4f98-8d96-64a9baf99cb1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:56.665930 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3fbca6c2-f3f2-4f98-8d96-64a9baf99cb1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1292 microversion: 2.1 time: 0.522319 Aug 02 08:53:56.686452 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 27/47] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:56 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1292 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:56.881089 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:56.894102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:56.897762 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:56.908636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5b7309a9-4c55-4df1-a3f0-269785c3db5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1339 microversion: 2.20 time: 0.333227 Aug 02 08:53:56.916555 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 21/48] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:53:56 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1339 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:53:57.158979 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-af29850d-7637-4ee4-9353-3970f55ebf3c tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:57.161107 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-af29850d-7637-4ee4-9353-3970f55ebf3c tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:57.192702 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-af29850d-7637-4ee4-9353-3970f55ebf3c tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:57.193351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-af29850d-7637-4ee4-9353-3970f55ebf3c tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:57.204242 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-af29850d-7637-4ee4-9353-3970f55ebf3c tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:57.204846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-af29850d-7637-4ee4-9353-3970f55ebf3c tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:57.273209 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-393639558", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f4da716-e6b0-4d5e-9aeb-55b720f45052"}], "security_groups": [{"name": "tempest-securitygroup--261978366"}], "key_name": "tempest-keypair-1857626531", "user_data": "}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:53:57.518146 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-af29850d-7637-4ee4-9353-3970f55ebf3c tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:57.534475 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-af29850d-7637-4ee4-9353-3970f55ebf3c tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1272 microversion: 2.1 time: 0.383105 Aug 02 08:53:57.538379 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 28/49] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:57 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1272 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:57.693971 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-906b5a3c-9076-4673-b353-26769c85af55 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:57.694653 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-906b5a3c-9076-4673-b353-26769c85af55 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:57.705209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-906b5a3c-9076-4673-b353-26769c85af55 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:57.705676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-906b5a3c-9076-4673-b353-26769c85af55 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:57.706498 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-906b5a3c-9076-4673-b353-26769c85af55 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:57.706948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-906b5a3c-9076-4673-b353-26769c85af55 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:58.219451 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-906b5a3c-9076-4673-b353-26769c85af55 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:58.231757 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-906b5a3c-9076-4673-b353-26769c85af55 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1280 microversion: 2.1 time: 0.541699 Aug 02 08:53:58.238478 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 29/50] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:57 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1280 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:53:58.253161 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:58.261001 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:58.284864 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:58.288718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:58.291513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:58.292674 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:58.496617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:58.509916 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:58.524810 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:58.533608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-97738960-0492-439f-8bd9-bbd6f82fd5a5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1339 microversion: 2.20 time: 0.289835 Aug 02 08:53:58.534607 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 30/51] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:53:58 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1339 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:53:58.560168 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-05a9b023-83ee-42f3-921a-d7ef9f40ed12 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:58.561034 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-05a9b023-83ee-42f3-921a-d7ef9f40ed12 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:58.573210 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-05a9b023-83ee-42f3-921a-d7ef9f40ed12 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:58.576798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-05a9b023-83ee-42f3-921a-d7ef9f40ed12 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:58.601455 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-05a9b023-83ee-42f3-921a-d7ef9f40ed12 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:58.602245 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-05a9b023-83ee-42f3-921a-d7ef9f40ed12 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:58.939690 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-05a9b023-83ee-42f3-921a-d7ef9f40ed12 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:53:58.961669 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-05a9b023-83ee-42f3-921a-d7ef9f40ed12 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1272 microversion: 2.1 time: 0.394919 Aug 02 08:53:58.966685 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 31/52] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:58 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1272 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:53:59.143184 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] validate_networks() for [('6f4da716-e6b0-4d5e-9aeb-55b720f45052', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:53:59.263967 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-21b8848d-a106-4c30-9e41-1f87298b598e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:53:59.265689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-21b8848d-a106-4c30-9e41-1f87298b598e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:53:59.283777 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21b8848d-a106-4c30-9e41-1f87298b598e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:59.286988 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21b8848d-a106-4c30-9e41-1f87298b598e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:53:59.297202 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21b8848d-a106-4c30-9e41-1f87298b598e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:53:59.298396 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21b8848d-a106-4c30-9e41-1f87298b598e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:00.271544 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-21b8848d-a106-4c30-9e41-1f87298b598e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:00.287854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-21b8848d-a106-4c30-9e41-1f87298b598e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 1.024608 Aug 02 08:54:00.303049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 32/53] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:53:59 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:00.327463 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:00.328930 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:00.342577 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:00.343661 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:00.354993 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:00.356738 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:00.680652 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:00.720847 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:00.725474 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:00.728204 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5ade6b65-07d8-4a3f-a8f7-61c0a5a41171 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1339 microversion: 2.20 time: 0.422812 Aug 02 08:54:00.729068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 33/54] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:00 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1339 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:00.753559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8bd05edb-3945-4d7f-92c0-6775691e07a2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:00.754290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8bd05edb-3945-4d7f-92c0-6775691e07a2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:00.783486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8bd05edb-3945-4d7f-92c0-6775691e07a2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:00.784567 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8bd05edb-3945-4d7f-92c0-6775691e07a2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:00.785716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8bd05edb-3945-4d7f-92c0-6775691e07a2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:00.786384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8bd05edb-3945-4d7f-92c0-6775691e07a2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:01.218986 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=4 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:01.965001 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8bd05edb-3945-4d7f-92c0-6775691e07a2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:01.998943 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8bd05edb-3945-4d7f-92c0-6775691e07a2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 1.263249 Aug 02 08:54:02.002203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 34/55] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:00 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:02.028655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-781ba26a-bdee-481b-8be3-ed378b6368cb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:02.033224 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-781ba26a-bdee-481b-8be3-ed378b6368cb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:02.044976 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-781ba26a-bdee-481b-8be3-ed378b6368cb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:02.048381 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-781ba26a-bdee-481b-8be3-ed378b6368cb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:02.049585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-781ba26a-bdee-481b-8be3-ed378b6368cb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:02.053278 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-781ba26a-bdee-481b-8be3-ed378b6368cb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:02.442219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=4 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:02.530849 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=20 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:03.318816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=20 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:04.230579 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:54:04.233061 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:54:04.233864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:54:04.235085 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:54:04.235822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:54:04.293059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:04.301471 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:04.303301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:04.305886 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:04.403033 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Getting quotas for project 7f068d1fec9a4e55b60cd782cf4ecf89. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:54:04.439382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Getting quotas for user 2b15c4ba64ca4097a4cdb653fdb94d78 and project 7f068d1fec9a4e55b60cd782cf4ecf89. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:54:04.489179 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:54:04.502519 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:54:04.516108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-781ba26a-bdee-481b-8be3-ed378b6368cb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:04.533194 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-781ba26a-bdee-481b-8be3-ed378b6368cb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 2.528195 Aug 02 08:54:04.537207 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 35/56] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:02 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:04.561472 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:04.567077 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:04.594775 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:04.595223 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:04.596022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:04.620488 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:04.699347 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8d0b3a2f-7cdb-4b7c-9b13-7d20282a162c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.435744 Aug 02 08:54:04.701647 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 22/57] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:53:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 7439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:54:05.300051 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-c01d3d01-e6e7-461a-a7a8-21c0e12ecddc req-21b146d1-d79d-43cb-a985-a3018b390c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a7f63d-5a88-4149-ba8c-843268dae669", "tag": "b4017272-12f4-4105-ad24-9c7d3c6b982e"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:05.350498 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-c01d3d01-e6e7-461a-a7a8-21c0e12ecddc req-21b146d1-d79d-43cb-a985-a3018b390c38 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:05.352548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-c01d3d01-e6e7-461a-a7a8-21c0e12ecddc req-21b146d1-d79d-43cb-a985-a3018b390c38 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:05.424523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-c01d3d01-e6e7-461a-a7a8-21c0e12ecddc req-21b146d1-d79d-43cb-a985-a3018b390c38 service nova] Creating event network-changed:b4017272-12f4-4105-ad24-9c7d3c6b982e for instance 64a7f63d-5a88-4149-ba8c-843268dae669 on hv-cinder-78729 Aug 02 08:54:05.430240 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-c01d3d01-e6e7-461a-a7a8-21c0e12ecddc req-21b146d1-d79d-43cb-a985-a3018b390c38 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 08:54:05.432469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3353ae48-5f73-487b-a7cf-d211bf95c007 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:05.433825 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3353ae48-5f73-487b-a7cf-d211bf95c007 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:05.441300 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3353ae48-5f73-487b-a7cf-d211bf95c007 None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:05.443772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3353ae48-5f73-487b-a7cf-d211bf95c007 None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:05.472066 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.compute.rpcapi [None req-3353ae48-5f73-487b-a7cf-d211bf95c007 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 08:54:05.473816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3353ae48-5f73-487b-a7cf-d211bf95c007 None None] Releasing lock "compute-rpcapi-router" {{(pid=117772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 08:54:05.503630 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3353ae48-5f73-487b-a7cf-d211bf95c007 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.799969 Aug 02 08:54:05.505113 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 23/58] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:05.517211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2d31b6a8-7fb2-4a1f-9876-d19579b6e621 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:05.518383 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2d31b6a8-7fb2-4a1f-9876-d19579b6e621 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:05.544339 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2d31b6a8-7fb2-4a1f-9876-d19579b6e621 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:05.545860 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2d31b6a8-7fb2-4a1f-9876-d19579b6e621 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:05.551398 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2d31b6a8-7fb2-4a1f-9876-d19579b6e621 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:05.553490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2d31b6a8-7fb2-4a1f-9876-d19579b6e621 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:05.901705 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:05.917277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:05.920621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:05.924971 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-cdd01d7b-26d6-4095-a36c-620a113ecbbd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 1.385540 Aug 02 08:54:05.928273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 36/59] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:04 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:05.987722 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7f8839d0-41a4-4c77-a1f0-68ef7208cfe3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:06.007875 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7f8839d0-41a4-4c77-a1f0-68ef7208cfe3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:06.507613 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7f8839d0-41a4-4c77-a1f0-68ef7208cfe3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:06.537732 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7f8839d0-41a4-4c77-a1f0-68ef7208cfe3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1237 microversion: 2.1 time: 0.598909 Aug 02 08:54:06.541418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 37/60] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:05 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1237 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:06.591624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-333a1585-7544-4278-980f-8345878928d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:06.595697 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-333a1585-7544-4278-980f-8345878928d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:06.613967 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-333a1585-7544-4278-980f-8345878928d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:06.614720 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-333a1585-7544-4278-980f-8345878928d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:06.616020 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-333a1585-7544-4278-980f-8345878928d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:06.616736 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-333a1585-7544-4278-980f-8345878928d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:06.741384 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2d31b6a8-7fb2-4a1f-9876-d19579b6e621 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:06.776439 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2d31b6a8-7fb2-4a1f-9876-d19579b6e621 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 1.269849 Aug 02 08:54:06.777044 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 24/61] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:05 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:06.956696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:06.957326 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:06.961332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:06.966663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:06.967516 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:06.968894 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:06.969694 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:07.129577 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-333a1585-7544-4278-980f-8345878928d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:07.155165 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-333a1585-7544-4278-980f-8345878928d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.589288 Aug 02 08:54:07.175568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 38/62] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:06 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:07.566642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-acb1194a-6271-4fac-a8bd-8dc5e03aeb03 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:07.567648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-acb1194a-6271-4fac-a8bd-8dc5e03aeb03 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:07.595192 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-acb1194a-6271-4fac-a8bd-8dc5e03aeb03 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:07.595637 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-acb1194a-6271-4fac-a8bd-8dc5e03aeb03 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:07.600937 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-acb1194a-6271-4fac-a8bd-8dc5e03aeb03 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:07.601472 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-acb1194a-6271-4fac-a8bd-8dc5e03aeb03 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:07.679451 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:07.698836 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:07.711941 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:07.714306 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1a3ff10b-cec5-4e98-b75a-81907788eb5f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.761902 Aug 02 08:54:07.716917 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 25/63] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:06 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:54:07.726172 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-1ddb7ec2-1d63-4c6e-b7e9-b354267d035e req-4d369b02-7302-4e26-8136-176d1a598066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa787e93-b3ba-4022-83c9-b3bf91be48ea", "tag": "53ef7d9d-8440-4f6f-8c2f-22ebcc0b6c0b"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:07.748617 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1ddb7ec2-1d63-4c6e-b7e9-b354267d035e req-4d369b02-7302-4e26-8136-176d1a598066 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:07.750346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1ddb7ec2-1d63-4c6e-b7e9-b354267d035e req-4d369b02-7302-4e26-8136-176d1a598066 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:07.794247 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-1ddb7ec2-1d63-4c6e-b7e9-b354267d035e req-4d369b02-7302-4e26-8136-176d1a598066 service nova] Creating event network-changed:53ef7d9d-8440-4f6f-8c2f-22ebcc0b6c0b for instance aa787e93-b3ba-4022-83c9-b3bf91be48ea on hv-cinder-78729 Aug 02 08:54:07.804349 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-1ddb7ec2-1d63-4c6e-b7e9-b354267d035e req-4d369b02-7302-4e26-8136-176d1a598066 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085441 Aug 02 08:54:07.805771 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 26/64] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:07.828723 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b6c9f338-ae2d-4137-8918-070204fabdbf tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:07.829746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b6c9f338-ae2d-4137-8918-070204fabdbf tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:07.835189 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-acb1194a-6271-4fac-a8bd-8dc5e03aeb03 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:07.865365 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-acb1194a-6271-4fac-a8bd-8dc5e03aeb03 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1289 microversion: 2.1 time: 0.303110 Aug 02 08:54:07.868621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 39/65] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:07 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1289 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:07.871852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6c9f338-ae2d-4137-8918-070204fabdbf tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:07.872716 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6c9f338-ae2d-4137-8918-070204fabdbf tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:07.873673 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6c9f338-ae2d-4137-8918-070204fabdbf tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:07.874262 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6c9f338-ae2d-4137-8918-070204fabdbf tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:08.186119 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1171d0c1-c724-4645-b346-66e1e79b8407 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:08.186884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1171d0c1-c724-4645-b346-66e1e79b8407 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:08.197014 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1171d0c1-c724-4645-b346-66e1e79b8407 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:08.198237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1171d0c1-c724-4645-b346-66e1e79b8407 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:08.199630 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1171d0c1-c724-4645-b346-66e1e79b8407 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:08.200348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1171d0c1-c724-4645-b346-66e1e79b8407 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:09.095308 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1171d0c1-c724-4645-b346-66e1e79b8407 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:09.106273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1171d0c1-c724-4645-b346-66e1e79b8407 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.928223 Aug 02 08:54:09.107048 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 40/66] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:08 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:09.111960 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:09.120984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:09.135500 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:09.136228 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:09.138393 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:09.142796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:09.391576 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:09.399236 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=100 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:09.404207 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:09.406262 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:09.407677 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b639d441-7f1e-4b0b-a66a-7c9545bd6643 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.299560 Aug 02 08:54:09.408732 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 41/67] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:09 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:09.413774 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-87f676ac-5e17-425c-9e15-4c35c4651616 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:09.414588 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-87f676ac-5e17-425c-9e15-4c35c4651616 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:09.422987 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-87f676ac-5e17-425c-9e15-4c35c4651616 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:09.423828 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-87f676ac-5e17-425c-9e15-4c35c4651616 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:09.424848 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-87f676ac-5e17-425c-9e15-4c35c4651616 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:09.425449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-87f676ac-5e17-425c-9e15-4c35c4651616 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:09.522579 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-87f676ac-5e17-425c-9e15-4c35c4651616 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:09.533453 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-87f676ac-5e17-425c-9e15-4c35c4651616 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1307 microversion: 2.1 time: 0.123403 Aug 02 08:54:09.534582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 42/68] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:09 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:09.550086 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b6c9f338-ae2d-4137-8918-070204fabdbf tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:09.575661 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b6c9f338-ae2d-4137-8918-070204fabdbf tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 1.749432 Aug 02 08:54:09.576463 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 27/69] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:07 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:09.908821 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1054907b-0295-45f7-ae64-b91fb992522c tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Action: 'create', calling method: .version_select at 0x7f13faf89550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2128159476", "metadata": {"Type": "work"}}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:09.926312 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-b4731818-67e2-475d-9406-f0bb4439458f req-1d80a4d8-1908-482a-8989-90247e818e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0bfc599-c1b3-4328-88b1-c8e505562480", "tag": "4265e426-406d-4e2d-b009-de8ff72ede37"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1054907b-0295-45f7-ae64-b91fb992522c tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Request method failure captured: Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 122 Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYwQY5OuYS3z1cuT90DErVhNf05bwaR7M6v8LqoaLOop-rKMJx6IUtxdV4VXRIJPWgrmIJyM91gymUlevmaqVzmx7DFSLcOkqLE9PXHzVL6LeZ2aAwaz1bEoZq2FBB5_oJm7qRpWn-BMzG-ihVoVBqO-VsFKNiDlwmDKIm4zYoawTU Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:54:09.931990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_386fd7f8d111413aacf7e7bdad3463f4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}] Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 09f5b0fb700a4e079090214abf62b761 Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2128159476", "metadata": {"Type": "work"}}} Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: Aug 02 08:54:09.933461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2128159476', 'metadata': {'Type': 'work'}}}} Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise error Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:54:09.934490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 08:54:09.942931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 08:54:09.944072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 08:54:09.944072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.944072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1054907b-0295-45f7-ae64-b91fb992522c tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:54:09.944072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1054907b-0295-45f7-ae64-b91fb992522c tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.398341 Aug 02 08:54:09.944072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 43/70] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 2 08:54:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 403 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 08:54:09.947548 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-add15d8a-f26c-4fc2-b492-8a896b57560e tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Action: 'create', calling method: .version_select at 0x7f13fae088b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1691170663", "metadata": {"Type": "work"}}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:09.961389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b4731818-67e2-475d-9406-f0bb4439458f req-1d80a4d8-1908-482a-8989-90247e818e68 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:09.961839 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b4731818-67e2-475d-9406-f0bb4439458f req-1d80a4d8-1908-482a-8989-90247e818e68 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-add15d8a-f26c-4fc2-b492-8a896b57560e tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Request method failure captured: Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 120 Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYwQY5OuYS3z1cuT90DErVhNf05bwaR7M6v8LqoaLOop-rKMJx6IUtxdV4VXRIJPWgrmIJyM91gymUlevmaqVzmx7DFSLcOkqLE9PXHzVL6LeZ2aAwaz1bEoZq2FBB5_oJm7qRpWn-BMzG-ihVoVBqO-VsFKNiDlwmDKIm4zYoawTU Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:54:09.964225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_386fd7f8d111413aacf7e7bdad3463f4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}] Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 09f5b0fb700a4e079090214abf62b761 Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1691170663", "metadata": {"Type": "work"}}} Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: Aug 02 08:54:09.965388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1691170663', 'metadata': {'Type': 'work'}}}} Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise error Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi '0' Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:54:09.966050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 08:54:09.967124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 08:54:09.969837 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 08:54:09.969837 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.969837 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-add15d8a-f26c-4fc2-b492-8a896b57560e tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:54:09.969837 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-add15d8a-f26c-4fc2-b492-8a896b57560e tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021964 Aug 02 08:54:09.974129 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 44/71] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 2 08:54:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 08:54:09.980430 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-67e4d485-678e-4c5e-9295-a4d603caf4b6 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Action: 'create', calling method: .version_select at 0x7f13faeb9940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-300190439", "metadata": {"Type": "work"}}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-67e4d485-678e-4c5e-9295-a4d603caf4b6 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Request method failure captured: Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 118 Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYwQY5OuYS3z1cuT90DErVhNf05bwaR7M6v8LqoaLOop-rKMJx6IUtxdV4VXRIJPWgrmIJyM91gymUlevmaqVzmx7DFSLcOkqLE9PXHzVL6LeZ2aAwaz1bEoZq2FBB5_oJm7qRpWn-BMzG-ihVoVBqO-VsFKNiDlwmDKIm4zYoawTU Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:54:09.985219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_386fd7f8d111413aacf7e7bdad3463f4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}] Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 09f5b0fb700a4e079090214abf62b761 Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-300190439", "metadata": {"Type": "work"}}} Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: Aug 02 08:54:09.986657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-300190439', 'metadata': {'Type': 'work'}}}} Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise error Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi '' Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:54:09.987486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 08:54:09.988873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 08:54:09.990032 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 08:54:09.990032 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:09.990180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-b4731818-67e2-475d-9406-f0bb4439458f req-1d80a4d8-1908-482a-8989-90247e818e68 service nova] Creating event network-changed:4265e426-406d-4e2d-b009-de8ff72ede37 for instance e0bfc599-c1b3-4328-88b1-c8e505562480 on hv-cinder-78729 Aug 02 08:54:09.990271 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-67e4d485-678e-4c5e-9295-a4d603caf4b6 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:54:09.990271 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-67e4d485-678e-4c5e-9295-a4d603caf4b6 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011480 Aug 02 08:54:09.992938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-b4731818-67e2-475d-9406-f0bb4439458f req-1d80a4d8-1908-482a-8989-90247e818e68 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413559 Aug 02 08:54:09.993801 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 45/72] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 2 08:54:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 08:54:09.998931 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 28/73] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:10.003666 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cfa1cdd1-16b9-4091-9523-bee0c69bbde8 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Calling method '.version_select at 0x7f13fae4da60>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:10.057171 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-cfa1cdd1-16b9-4091-9523-bee0c69bbde8 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] HTTP exception thrown: Volume tempest-invalid-1409877962 could not be found. Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cfa1cdd1-16b9-4091-9523-bee0c69bbde8 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Request method failure captured: Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1409877962 HTTP/1.1 Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYwQY5OuYS3z1cuT90DErVhNf05bwaR7M6v8LqoaLOop-rKMJx6IUtxdV4VXRIJPWgrmIJyM91gymUlevmaqVzmx7DFSLcOkqLE9PXHzVL6LeZ2aAwaz1bEoZq2FBB5_oJm7qRpWn-BMzG-ihVoVBqO-VsFKNiDlwmDKIm4zYoawTU Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:54:10.059587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_386fd7f8d111413aacf7e7bdad3463f4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}] Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 09f5b0fb700a4e079090214abf62b761 Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Volume tempest-invalid-1409877962 could not be found. Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'tempest-invalid-1409877962'} Aug 02 08:54:10.060855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1409877962 could not be found. (HTTP 404) (Request-ID: req-4f7f8880-fc0e-404a-899a-91fe4d5fe071) Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.061564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 08:54:10.063408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1409877962 could not be found. Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:54:10.064568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1409877962 could not be found. Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1409877962 could not be found. Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cfa1cdd1-16b9-4091-9523-bee0c69bbde8 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Returning 404 to user: Volume tempest-invalid-1409877962 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-cfa1cdd1-16b9-4091-9523-bee0c69bbde8 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1409877962" status: 404 len: 99 microversion: 2.1 time: 0.066249 Aug 02 08:54:10.065858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 46/74] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 2 08:54:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1409877962 => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 08:54:10.073093 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-48f20a30-c53c-49f8-9902-9726cf9e35cc tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005062 Aug 02 08:54:10.074255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 29/75] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Aug 2 08:54:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 08:54:10.083402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8c3d494a-5677-4015-a598-c9876fb7562d tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003921 Aug 02 08:54:10.084359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 47/76] 10.222.0.17 () {58 vars in 1137 bytes} [Tue Aug 2 08:54:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 08:54:10.093272 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2bc46004-dc3f-41b4-b6ff-52823b98c04b tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Calling method '.version_select at 0x7f13faea0820>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:10.134829 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-494d8b1f-fafa-4c89-a828-ac7e088f585b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:10.136013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-2bc46004-dc3f-41b4-b6ff-52823b98c04b tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] HTTP exception thrown: Volume d6762b9a-a200-48db-a073-f17be499d268 could not be found. Aug 02 08:54:10.137026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-494d8b1f-fafa-4c89-a828-ac7e088f585b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2bc46004-dc3f-41b4-b6ff-52823b98c04b tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Request method failure captured: Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/os-volumes/d6762b9a-a200-48db-a073-f17be499d268 HTTP/1.1 Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYwQY5OuYS3z1cuT90DErVhNf05bwaR7M6v8LqoaLOop-rKMJx6IUtxdV4VXRIJPWgrmIJyM91gymUlevmaqVzmx7DFSLcOkqLE9PXHzVL6LeZ2aAwaz1bEoZq2FBB5_oJm7qRpWn-BMzG-ihVoVBqO-VsFKNiDlwmDKIm4zYoawTU Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 08:54:10.138546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_386fd7f8d111413aacf7e7bdad3463f4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}] Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 09f5b0fb700a4e079090214abf62b761 Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Volume d6762b9a-a200-48db-a073-f17be499d268 could not be found. Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'd6762b9a-a200-48db-a073-f17be499d268'} Aug 02 08:54:10.140221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6762b9a-a200-48db-a073-f17be499d268 could not be found. (HTTP 404) (Request-ID: req-62386fbf-721c-4b53-a6db-bbefa1f3c364) Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.141432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 08:54:10.142568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6762b9a-a200-48db-a073-f17be499d268 could not be found. Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 08:54:10.143695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6762b9a-a200-48db-a073-f17be499d268 could not be found. Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6762b9a-a200-48db-a073-f17be499d268 could not be found. Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2bc46004-dc3f-41b4-b6ff-52823b98c04b tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Returning 404 to user: Volume d6762b9a-a200-48db-a073-f17be499d268 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2bc46004-dc3f-41b4-b6ff-52823b98c04b tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/d6762b9a-a200-48db-a073-f17be499d268" status: 404 len: 109 microversion: 2.1 time: 0.052522 Aug 02 08:54:10.144935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 30/77] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 08:54:10 2022] DELETE /compute/v2.1/os-volumes/d6762b9a-a200-48db-a073-f17be499d268 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:54:10.153627 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-27492c29-6ef5-42ff-a900-4631dd189505 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Calling method '.version_select at 0x7f13faf251f0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:10.153942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-494d8b1f-fafa-4c89-a828-ac7e088f585b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:10.154440 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-494d8b1f-fafa-4c89-a828-ac7e088f585b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:10.156658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-494d8b1f-fafa-4c89-a828-ac7e088f585b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:10.159601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-494d8b1f-fafa-4c89-a828-ac7e088f585b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:10.193209 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-27492c29-6ef5-42ff-a900-4631dd189505 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] HTTP exception thrown: Volume 9d827468-6ed4-4bde-8dbc-488bb28c7328 could not be found. Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-27492c29-6ef5-42ff-a900-4631dd189505 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Request method failure captured: Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/os-volumes/9d827468-6ed4-4bde-8dbc-488bb28c7328 HTTP/1.1 Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYwQY5OuYS3z1cuT90DErVhNf05bwaR7M6v8LqoaLOop-rKMJx6IUtxdV4VXRIJPWgrmIJyM91gymUlevmaqVzmx7DFSLcOkqLE9PXHzVL6LeZ2aAwaz1bEoZq2FBB5_oJm7qRpWn-BMzG-ihVoVBqO-VsFKNiDlwmDKIm4zYoawTU Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 08:54:10.195544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_386fd7f8d111413aacf7e7bdad3463f4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/386fd7f8d111413aacf7e7bdad3463f4"}]}] Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 386fd7f8d111413aacf7e7bdad3463f4 Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-VolumesNegativeTest-214965724 Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 09f5b0fb700a4e079090214abf62b761 Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-VolumesNegativeTest-214965724-project Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Volume 9d827468-6ed4-4bde-8dbc-488bb28c7328 could not be found. Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '9d827468-6ed4-4bde-8dbc-488bb28c7328'} Aug 02 08:54:10.196677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d827468-6ed4-4bde-8dbc-488bb28c7328 could not be found. (HTTP 404) (Request-ID: req-e028ccc7-ecc8-43dd-9d9a-7e1ec0616add) Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.197448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 08:54:10.207266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d827468-6ed4-4bde-8dbc-488bb28c7328 could not be found. Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 08:54:10.208929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d827468-6ed4-4bde-8dbc-488bb28c7328 could not be found. Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d827468-6ed4-4bde-8dbc-488bb28c7328 could not be found. Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-27492c29-6ef5-42ff-a900-4631dd189505 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] Returning 404 to user: Volume 9d827468-6ed4-4bde-8dbc-488bb28c7328 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-27492c29-6ef5-42ff-a900-4631dd189505 tempest-VolumesNegativeTest-214965724 tempest-VolumesNegativeTest-214965724-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9d827468-6ed4-4bde-8dbc-488bb28c7328" status: 404 len: 109 microversion: 2.1 time: 0.048319 Aug 02 08:54:10.211095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 31/78] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 08:54:10 2022] GET /compute/v2.1/os-volumes/9d827468-6ed4-4bde-8dbc-488bb28c7328 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:54:10.402403 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-494d8b1f-fafa-4c89-a828-ac7e088f585b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:10.414965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-494d8b1f-fafa-4c89-a828-ac7e088f585b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.283624 Aug 02 08:54:10.431003 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 48/79] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:10 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:10.434124 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:10.434981 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:10.441835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:10.442399 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:10.443261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:10.443887 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:10.555430 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f5d9292c-3553-4a62-a419-9d4495f79e62 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:10.556044 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f5d9292c-3553-4a62-a419-9d4495f79e62 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:10.566443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5d9292c-3553-4a62-a419-9d4495f79e62 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:10.567359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5d9292c-3553-4a62-a419-9d4495f79e62 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:10.570092 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5d9292c-3553-4a62-a419-9d4495f79e62 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:10.571155 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5d9292c-3553-4a62-a419-9d4495f79e62 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:10.620778 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:10.629736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:10.631494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:10.632741 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2c48433c-3b28-457b-bc9f-e9b545cea091 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.202702 Aug 02 08:54:10.633849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 32/80] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:10 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:10.638901 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7557a7f5-ffdb-4fd9-bae2-c86f1dd6afac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:10.639710 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7557a7f5-ffdb-4fd9-bae2-c86f1dd6afac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:10.646493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7557a7f5-ffdb-4fd9-bae2-c86f1dd6afac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:10.647141 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7557a7f5-ffdb-4fd9-bae2-c86f1dd6afac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:10.648179 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7557a7f5-ffdb-4fd9-bae2-c86f1dd6afac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:10.649255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7557a7f5-ffdb-4fd9-bae2-c86f1dd6afac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:10.724326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f5d9292c-3553-4a62-a419-9d4495f79e62 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:10.735115 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f5d9292c-3553-4a62-a419-9d4495f79e62 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1295 microversion: 2.1 time: 0.184122 Aug 02 08:54:10.749360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 49/81] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:10 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1295 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:10.890003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7557a7f5-ffdb-4fd9-bae2-c86f1dd6afac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:10.903550 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7557a7f5-ffdb-4fd9-bae2-c86f1dd6afac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.268405 Aug 02 08:54:10.904026 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 33/82] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:10 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:11.438815 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a4fde7fe-caca-4724-beb8-7cb962173884 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:11.439434 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a4fde7fe-caca-4724-beb8-7cb962173884 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:11.446971 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4fde7fe-caca-4724-beb8-7cb962173884 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:11.447671 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4fde7fe-caca-4724-beb8-7cb962173884 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:11.449209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4fde7fe-caca-4724-beb8-7cb962173884 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:11.449799 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4fde7fe-caca-4724-beb8-7cb962173884 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:11.631456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a4fde7fe-caca-4724-beb8-7cb962173884 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:11.638899 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a4fde7fe-caca-4724-beb8-7cb962173884 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.204655 Aug 02 08:54:11.639462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 50/83] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:11 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:11.657407 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:11.658120 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:11.664730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:11.665338 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:11.666129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:11.666694 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:11.758803 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-385f3b2a-ce5c-4a20-bd9a-1a93acd5d2f8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:11.759419 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-385f3b2a-ce5c-4a20-bd9a-1a93acd5d2f8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:11.762335 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:11.767122 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-385f3b2a-ce5c-4a20-bd9a-1a93acd5d2f8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:11.767575 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-385f3b2a-ce5c-4a20-bd9a-1a93acd5d2f8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:11.768394 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-385f3b2a-ce5c-4a20-bd9a-1a93acd5d2f8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:11.768842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-385f3b2a-ce5c-4a20-bd9a-1a93acd5d2f8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:11.842230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:11.852235 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:11.853873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:11.855007 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-28486185-2afe-4372-92f2-3695bd6dbaae tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.202182 Aug 02 08:54:11.855577 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 34/84] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:11 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:54:11.871217 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-385f3b2a-ce5c-4a20-bd9a-1a93acd5d2f8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:11.879820 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-385f3b2a-ce5c-4a20-bd9a-1a93acd5d2f8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1295 microversion: 2.1 time: 0.124826 Aug 02 08:54:11.880966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 51/85] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:11 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1295 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:11.925350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-84beb8a8-2514-4b99-96f1-f0568894e1fe tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:11.926545 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-84beb8a8-2514-4b99-96f1-f0568894e1fe tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:11.933170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84beb8a8-2514-4b99-96f1-f0568894e1fe tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:11.933545 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84beb8a8-2514-4b99-96f1-f0568894e1fe tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:11.934316 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84beb8a8-2514-4b99-96f1-f0568894e1fe tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:11.934915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84beb8a8-2514-4b99-96f1-f0568894e1fe tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.042953 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-ebb3e656-2771-4eac-86a4-e667606db77c req-addf8f2f-5565-46b9-b5d6-6a44f2100162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f9c72f-350b-428c-b020-d16159e0c991", "tag": "f3e02b9c-83d3-460c-8aac-b98eba055bb0"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:12.064286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-ebb3e656-2771-4eac-86a4-e667606db77c req-addf8f2f-5565-46b9-b5d6-6a44f2100162 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.075467 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-ebb3e656-2771-4eac-86a4-e667606db77c req-addf8f2f-5565-46b9-b5d6-6a44f2100162 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.128816 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-ebb3e656-2771-4eac-86a4-e667606db77c req-addf8f2f-5565-46b9-b5d6-6a44f2100162 service nova] Creating event network-changed:f3e02b9c-83d3-460c-8aac-b98eba055bb0 for instance b1f9c72f-350b-428c-b020-d16159e0c991 on hv-cinder-78729 Aug 02 08:54:12.129384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-ebb3e656-2771-4eac-86a4-e667606db77c req-addf8f2f-5565-46b9-b5d6-6a44f2100162 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117773) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 08:54:12.130571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7bb66e6-7d32-4f38-bc17-230d5a826569 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.133555 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7bb66e6-7d32-4f38-bc17-230d5a826569 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.134467 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7bb66e6-7d32-4f38-bc17-230d5a826569 None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.134912 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7bb66e6-7d32-4f38-bc17-230d5a826569 None None] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.150501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.compute.rpcapi [None req-d7bb66e6-7d32-4f38-bc17-230d5a826569 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 08:54:12.156600 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7bb66e6-7d32-4f38-bc17-230d5a826569 None None] Releasing lock "compute-rpcapi-router" {{(pid=117773) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 08:54:12.191451 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d7bb66e6-7d32-4f38-bc17-230d5a826569 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152407 Aug 02 08:54:12.192063 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 52/86] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:12.487433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-84beb8a8-2514-4b99-96f1-f0568894e1fe tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:12.502518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-84beb8a8-2514-4b99-96f1-f0568894e1fe tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.580998 Aug 02 08:54:12.503737 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 35/87] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:11 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:12.664226 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d7d8d1dc-0db5-447c-8425-557e09ace30d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:12.665486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d7d8d1dc-0db5-447c-8425-557e09ace30d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:12.672742 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7d8d1dc-0db5-447c-8425-557e09ace30d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.673459 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7d8d1dc-0db5-447c-8425-557e09ace30d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.674233 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7d8d1dc-0db5-447c-8425-557e09ace30d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.674817 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7d8d1dc-0db5-447c-8425-557e09ace30d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.861549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d7d8d1dc-0db5-447c-8425-557e09ace30d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:12.872065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d7d8d1dc-0db5-447c-8425-557e09ace30d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.211764 Aug 02 08:54:12.873170 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 53/88] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:12 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:12.877791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:12.878397 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:12.886506 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.887363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.888169 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.889044 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.906654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9af59b06-d031-495e-972d-2dca303bc2b8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:12.907534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9af59b06-d031-495e-972d-2dca303bc2b8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:12.915194 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9af59b06-d031-495e-972d-2dca303bc2b8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.915817 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9af59b06-d031-495e-972d-2dca303bc2b8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:12.917678 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9af59b06-d031-495e-972d-2dca303bc2b8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:12.917678 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9af59b06-d031-495e-972d-2dca303bc2b8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:13.000330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9af59b06-d031-495e-972d-2dca303bc2b8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:13.009206 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9af59b06-d031-495e-972d-2dca303bc2b8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1295 microversion: 2.1 time: 0.106973 Aug 02 08:54:13.009960 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 54/89] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:12 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:13.109962 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:13.120815 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:13.122353 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:13.123471 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-74badff8-ca01-4496-b214-360a643f7d7e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.249541 Aug 02 08:54:13.136666 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 36/90] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:12 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:54:13.524859 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cb7e36ee-49b9-4a7a-88fd-f068b966ae3f tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:13.525597 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-cb7e36ee-49b9-4a7a-88fd-f068b966ae3f tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:13.532764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cb7e36ee-49b9-4a7a-88fd-f068b966ae3f tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:13.533735 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cb7e36ee-49b9-4a7a-88fd-f068b966ae3f tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:13.534750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cb7e36ee-49b9-4a7a-88fd-f068b966ae3f tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:13.535390 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cb7e36ee-49b9-4a7a-88fd-f068b966ae3f tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:13.725826 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-cb7e36ee-49b9-4a7a-88fd-f068b966ae3f tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:13.740046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-cb7e36ee-49b9-4a7a-88fd-f068b966ae3f tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.218841 Aug 02 08:54:13.741330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 55/91] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:13 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:13.896825 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d97e490e-9e6c-40ea-a533-247fa9c99334 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:13.898335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d97e490e-9e6c-40ea-a533-247fa9c99334 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:13.908025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d97e490e-9e6c-40ea-a533-247fa9c99334 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:13.909403 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d97e490e-9e6c-40ea-a533-247fa9c99334 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:13.911084 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d97e490e-9e6c-40ea-a533-247fa9c99334 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:13.911687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d97e490e-9e6c-40ea-a533-247fa9c99334 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:14.031935 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fccb7d41-9e15-4d4c-88af-b014ef21834b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:14.032628 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fccb7d41-9e15-4d4c-88af-b014ef21834b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:14.040879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fccb7d41-9e15-4d4c-88af-b014ef21834b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:14.041199 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fccb7d41-9e15-4d4c-88af-b014ef21834b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:14.042621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fccb7d41-9e15-4d4c-88af-b014ef21834b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:14.043174 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fccb7d41-9e15-4d4c-88af-b014ef21834b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:14.223906 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fccb7d41-9e15-4d4c-88af-b014ef21834b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:14.224990 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d97e490e-9e6c-40ea-a533-247fa9c99334 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:14.235713 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fccb7d41-9e15-4d4c-88af-b014ef21834b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.208035 Aug 02 08:54:14.237744 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 56/92] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:14 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:14.239343 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d97e490e-9e6c-40ea-a533-247fa9c99334 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.348282 Aug 02 08:54:14.240613 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 37/93] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:13 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:14.243352 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:14.244176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:14.251569 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:14.252328 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:14.254539 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:14.255450 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:14.529763 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:14.558036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:14.563209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:14.565518 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ee101597-eec4-44ec-b3f0-732c5627d118 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.326528 Aug 02 08:54:14.580733 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 57/94] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:14 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:14.766570 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7782e544-8b21-4056-bec8-d9697cfe8212 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:14.767958 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7782e544-8b21-4056-bec8-d9697cfe8212 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:14.778165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=6 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:14.782061 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7782e544-8b21-4056-bec8-d9697cfe8212 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:14.783387 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7782e544-8b21-4056-bec8-d9697cfe8212 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:14.785117 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7782e544-8b21-4056-bec8-d9697cfe8212 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:14.786212 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7782e544-8b21-4056-bec8-d9697cfe8212 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:14.794513 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=100 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:15.074054 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7782e544-8b21-4056-bec8-d9697cfe8212 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:15.082604 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7782e544-8b21-4056-bec8-d9697cfe8212 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.323525 Aug 02 08:54:15.096882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 38/95] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:14 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:15.263547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-be63ca6b-5c8b-4ccd-a320-e6fd09dfaf52 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:15.264206 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-be63ca6b-5c8b-4ccd-a320-e6fd09dfaf52 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:15.270492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2341d5f1-4209-4b78-8086-c621a1c0c46f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:15.271116 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2341d5f1-4209-4b78-8086-c621a1c0c46f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:15.280527 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2341d5f1-4209-4b78-8086-c621a1c0c46f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:15.281069 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2341d5f1-4209-4b78-8086-c621a1c0c46f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:15.281922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2341d5f1-4209-4b78-8086-c621a1c0c46f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:15.282496 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2341d5f1-4209-4b78-8086-c621a1c0c46f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:15.289043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-be63ca6b-5c8b-4ccd-a320-e6fd09dfaf52 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:15.289500 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-be63ca6b-5c8b-4ccd-a320-e6fd09dfaf52 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:15.290295 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-be63ca6b-5c8b-4ccd-a320-e6fd09dfaf52 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:15.290739 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-be63ca6b-5c8b-4ccd-a320-e6fd09dfaf52 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:15.466674 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=4 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:15.699218 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-be63ca6b-5c8b-4ccd-a320-e6fd09dfaf52 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:15.710662 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-be63ca6b-5c8b-4ccd-a320-e6fd09dfaf52 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.451624 Aug 02 08:54:15.711344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 58/96] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:15 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:15.716329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:15.716942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:15.725333 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:15.725795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:15.726993 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:15.727443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:15.780084 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2341d5f1-4209-4b78-8086-c621a1c0c46f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:15.789720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2341d5f1-4209-4b78-8086-c621a1c0c46f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.532589 Aug 02 08:54:15.794258 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 39/97] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:15 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:15.981834 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:15.994225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:15.998150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:15.999710 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-86f9eb40-9767-4139-b9a5-ec7c2edf645d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.287387 Aug 02 08:54:16.001755 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 59/98] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:15 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:16.106161 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-da3c65f2-8e6b-42f6-a275-8e273e3e5b95 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:16.106918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-da3c65f2-8e6b-42f6-a275-8e273e3e5b95 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:16.115344 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da3c65f2-8e6b-42f6-a275-8e273e3e5b95 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:16.115805 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da3c65f2-8e6b-42f6-a275-8e273e3e5b95 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:16.116864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da3c65f2-8e6b-42f6-a275-8e273e3e5b95 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:16.117061 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da3c65f2-8e6b-42f6-a275-8e273e3e5b95 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:16.712047 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-da3c65f2-8e6b-42f6-a275-8e273e3e5b95 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:16.728403 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-da3c65f2-8e6b-42f6-a275-8e273e3e5b95 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.627525 Aug 02 08:54:16.734131 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 40/99] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:16 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:16.736931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-36eccb73-a7ea-41e3-9048-2615e68aa297 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:16.737558 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-36eccb73-a7ea-41e3-9048-2615e68aa297 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:16.739718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:16.762546 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-36eccb73-a7ea-41e3-9048-2615e68aa297 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:16.763890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-1b0d08ab-9ee8-4a0b-bd8f-4318b72c8eda req-65648ee2-db33-4749-880b-6df180e28cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92713a6-b49a-4dd4-b944-0d370dd4326d", "tag": "095a6c69-d447-4b1f-90e1-70752ef97699"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:16.771961 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-36eccb73-a7ea-41e3-9048-2615e68aa297 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:16.776186 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-36eccb73-a7ea-41e3-9048-2615e68aa297 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:16.778741 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-36eccb73-a7ea-41e3-9048-2615e68aa297 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:16.784841 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1b0d08ab-9ee8-4a0b-bd8f-4318b72c8eda req-65648ee2-db33-4749-880b-6df180e28cde service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:16.785539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1b0d08ab-9ee8-4a0b-bd8f-4318b72c8eda req-65648ee2-db33-4749-880b-6df180e28cde service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:16.823062 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-1b0d08ab-9ee8-4a0b-bd8f-4318b72c8eda req-65648ee2-db33-4749-880b-6df180e28cde service nova] Creating event network-changed:095a6c69-d447-4b1f-90e1-70752ef97699 for instance a92713a6-b49a-4dd4-b944-0d370dd4326d on hv-cinder-78729 Aug 02 08:54:16.829780 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-1b0d08ab-9ee8-4a0b-bd8f-4318b72c8eda req-65648ee2-db33-4749-880b-6df180e28cde service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072843 Aug 02 08:54:16.830695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 41/100] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 02 08:54:16.837597 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e75e7da6-a7ba-4a6b-a08d-c7ebc5a82818 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:16.838551 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e75e7da6-a7ba-4a6b-a08d-c7ebc5a82818 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:16.850866 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e75e7da6-a7ba-4a6b-a08d-c7ebc5a82818 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:16.851644 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e75e7da6-a7ba-4a6b-a08d-c7ebc5a82818 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:16.852878 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e75e7da6-a7ba-4a6b-a08d-c7ebc5a82818 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:16.853466 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e75e7da6-a7ba-4a6b-a08d-c7ebc5a82818 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:17.138109 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e75e7da6-a7ba-4a6b-a08d-c7ebc5a82818 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:17.144423 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-36eccb73-a7ea-41e3-9048-2615e68aa297 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:17.146979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e75e7da6-a7ba-4a6b-a08d-c7ebc5a82818 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.315034 Aug 02 08:54:17.147768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 42/101] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:16 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:17.168760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-36eccb73-a7ea-41e3-9048-2615e68aa297 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.435882 Aug 02 08:54:17.169452 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 60/102] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:16 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:17.171431 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:17.172278 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:17.178817 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:17.179492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:17.180854 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:17.181444 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:17.461162 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:17.471151 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:17.472938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:17.474676 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4ad20017-5c7d-4df9-baef-e549f7f8707a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.311015 Aug 02 08:54:17.475576 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 43/103] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:17 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:17.757139 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9dd23769-83a6-4a39-b51b-44f38b4081d3 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:17.758631 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9dd23769-83a6-4a39-b51b-44f38b4081d3 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:17.769458 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9dd23769-83a6-4a39-b51b-44f38b4081d3 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:17.770183 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9dd23769-83a6-4a39-b51b-44f38b4081d3 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:17.771196 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9dd23769-83a6-4a39-b51b-44f38b4081d3 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:17.772075 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9dd23769-83a6-4a39-b51b-44f38b4081d3 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:18.138141 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9dd23769-83a6-4a39-b51b-44f38b4081d3 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:18.148570 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9dd23769-83a6-4a39-b51b-44f38b4081d3 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.397327 Aug 02 08:54:18.157769 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 61/104] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:17 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:18.179454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e507c1b4-8296-41a9-bb9a-541cc145e65b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:18.180676 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e507c1b4-8296-41a9-bb9a-541cc145e65b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:18.189900 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e507c1b4-8296-41a9-bb9a-541cc145e65b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:18.190244 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-21a77c77-cf02-4793-9653-074e9aa6a895 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:18.190756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e507c1b4-8296-41a9-bb9a-541cc145e65b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:18.190876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-21a77c77-cf02-4793-9653-074e9aa6a895 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:18.191884 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e507c1b4-8296-41a9-bb9a-541cc145e65b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:18.192508 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e507c1b4-8296-41a9-bb9a-541cc145e65b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:18.200686 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21a77c77-cf02-4793-9653-074e9aa6a895 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:18.201139 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21a77c77-cf02-4793-9653-074e9aa6a895 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:18.201919 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21a77c77-cf02-4793-9653-074e9aa6a895 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:18.202482 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21a77c77-cf02-4793-9653-074e9aa6a895 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:18.476165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e507c1b4-8296-41a9-bb9a-541cc145e65b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:18.504817 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e507c1b4-8296-41a9-bb9a-541cc145e65b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.329766 Aug 02 08:54:18.506362 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 44/105] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:18 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:18.527426 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:18.530060 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:18.545707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:18.546283 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:18.553124 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:18.553614 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:18.726073 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-21a77c77-cf02-4793-9653-074e9aa6a895 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:18.735072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-21a77c77-cf02-4793-9653-074e9aa6a895 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.549023 Aug 02 08:54:18.741281 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 62/106] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:18 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:18.904392 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:18.912926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:18.914654 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:18.915779 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4476352c-c709-43f2-a6a8-d6b662504e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.400967 Aug 02 08:54:18.916597 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 45/107] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:18 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:19.183179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-afa53d8c-84db-4a2f-af71-5ae40aea95ba tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:19.184618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-afa53d8c-84db-4a2f-af71-5ae40aea95ba tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:19.209857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-afa53d8c-84db-4a2f-af71-5ae40aea95ba tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:19.210529 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-afa53d8c-84db-4a2f-af71-5ae40aea95ba tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:19.212584 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-afa53d8c-84db-4a2f-af71-5ae40aea95ba tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:19.213402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-afa53d8c-84db-4a2f-af71-5ae40aea95ba tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:19.535882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7f57f844-a022-4411-b436-a14eb12c1df9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:19.539520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7f57f844-a022-4411-b436-a14eb12c1df9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:19.562062 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f57f844-a022-4411-b436-a14eb12c1df9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:19.562711 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f57f844-a022-4411-b436-a14eb12c1df9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:19.564110 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f57f844-a022-4411-b436-a14eb12c1df9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:19.564922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f57f844-a022-4411-b436-a14eb12c1df9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:19.994197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-afa53d8c-84db-4a2f-af71-5ae40aea95ba tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:19.997852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=100 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:20.008915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-afa53d8c-84db-4a2f-af71-5ae40aea95ba tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.829260 Aug 02 08:54:20.010646 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 63/108] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:19 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:20.018718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4360284d-22f7-437b-9c11-68ff96db11ac tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:20.022574 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4360284d-22f7-437b-9c11-68ff96db11ac tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:20.039086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4360284d-22f7-437b-9c11-68ff96db11ac tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:20.043922 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4360284d-22f7-437b-9c11-68ff96db11ac tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:20.045298 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4360284d-22f7-437b-9c11-68ff96db11ac tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:20.051909 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4360284d-22f7-437b-9c11-68ff96db11ac tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:20.146377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7f57f844-a022-4411-b436-a14eb12c1df9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:20.168873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7f57f844-a022-4411-b436-a14eb12c1df9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.640390 Aug 02 08:54:20.208233 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 46/109] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:19 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:20.217210 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:20.222460 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:20.251562 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:20.253114 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:20.263300 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:20.264539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:20.451619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4360284d-22f7-437b-9c11-68ff96db11ac tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:20.475725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4360284d-22f7-437b-9c11-68ff96db11ac tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.461901 Aug 02 08:54:20.478676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 64/110] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:20 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:20.651349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-61ac553d-12ce-4fc6-9202-1b03f63785d3 req-af3e90fb-0cc1-450e-a853-6a3c93f92f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a7f63d-5a88-4149-ba8c-843268dae669", "name": "network-vif-plugged", "status": "completed", "tag": "b4017272-12f4-4105-ad24-9c7d3c6b982e"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:20.660909 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-61ac553d-12ce-4fc6-9202-1b03f63785d3 req-af3e90fb-0cc1-450e-a853-6a3c93f92f98 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:20.661359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-61ac553d-12ce-4fc6-9202-1b03f63785d3 req-af3e90fb-0cc1-450e-a853-6a3c93f92f98 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:20.679022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-61ac553d-12ce-4fc6-9202-1b03f63785d3 req-af3e90fb-0cc1-450e-a853-6a3c93f92f98 service nova] Creating event network-vif-plugged:b4017272-12f4-4105-ad24-9c7d3c6b982e for instance 64a7f63d-5a88-4149-ba8c-843268dae669 on hv-cinder-78729 Aug 02 08:54:20.689089 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-61ac553d-12ce-4fc6-9202-1b03f63785d3 req-af3e90fb-0cc1-450e-a853-6a3c93f92f98 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209052 Aug 02 08:54:20.689698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 65/111] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:21.040877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ee17e591-1bc2-4705-a1d8-1d5e11bd97c2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:21.043753 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ee17e591-1bc2-4705-a1d8-1d5e11bd97c2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:21.058466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee17e591-1bc2-4705-a1d8-1d5e11bd97c2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:21.060262 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee17e591-1bc2-4705-a1d8-1d5e11bd97c2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:21.061757 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee17e591-1bc2-4705-a1d8-1d5e11bd97c2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:21.063145 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee17e591-1bc2-4705-a1d8-1d5e11bd97c2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:21.101274 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:21.110237 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:21.114476 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:21.115679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-dad36aab-2cb3-4644-befc-295499676f3d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.905914 Aug 02 08:54:21.131744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 47/112] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:20 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:21.208544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b4d9156c-8bab-466a-a110-ecda733ece2c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:21.209814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b4d9156c-8bab-466a-a110-ecda733ece2c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:21.219469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4d9156c-8bab-466a-a110-ecda733ece2c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:21.223522 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4d9156c-8bab-466a-a110-ecda733ece2c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:21.225252 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4d9156c-8bab-466a-a110-ecda733ece2c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:21.225982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4d9156c-8bab-466a-a110-ecda733ece2c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:21.369590 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ee17e591-1bc2-4705-a1d8-1d5e11bd97c2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:21.380232 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ee17e591-1bc2-4705-a1d8-1d5e11bd97c2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.351962 Aug 02 08:54:21.381552 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 66/113] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:21 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:21.487563 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b4d9156c-8bab-466a-a110-ecda733ece2c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:21.500876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a4a344a9-fe0f-44a0-b9e3-385100a42831 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:21.502104 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a4a344a9-fe0f-44a0-b9e3-385100a42831 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:21.518934 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b4d9156c-8bab-466a-a110-ecda733ece2c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.311921 Aug 02 08:54:21.519728 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 48/114] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:21 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:21.521235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4a344a9-fe0f-44a0-b9e3-385100a42831 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:21.524645 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4a344a9-fe0f-44a0-b9e3-385100a42831 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:21.525626 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4a344a9-fe0f-44a0-b9e3-385100a42831 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:21.526209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4a344a9-fe0f-44a0-b9e3-385100a42831 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:21.779995 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a4a344a9-fe0f-44a0-b9e3-385100a42831 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:21.794480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a4a344a9-fe0f-44a0-b9e3-385100a42831 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.297462 Aug 02 08:54:21.795610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 67/115] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:21 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:22.139667 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:22.142620 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:22.150842 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.151296 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.158120 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.158684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.404885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f74b8829-ed24-468a-bee6-5db35252619e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:22.407101 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f74b8829-ed24-468a-bee6-5db35252619e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:22.409388 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:22.409985 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:22.428860 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f74b8829-ed24-468a-bee6-5db35252619e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.430752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f74b8829-ed24-468a-bee6-5db35252619e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.433247 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f74b8829-ed24-468a-bee6-5db35252619e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.434778 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:22.436463 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f74b8829-ed24-468a-bee6-5db35252619e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.439205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:22.441357 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fa867814-a1b7-42b3-a081-673713df5f12 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.305742 Aug 02 08:54:22.442038 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 49/116] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:22 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:22.544000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-13b67e6a-bfe5-45b0-9926-41ef72e44573 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:22.545246 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-13b67e6a-bfe5-45b0-9926-41ef72e44573 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:22.557657 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-13b67e6a-bfe5-45b0-9926-41ef72e44573 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.559276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-13b67e6a-bfe5-45b0-9926-41ef72e44573 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.562908 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-13b67e6a-bfe5-45b0-9926-41ef72e44573 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.563493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-13b67e6a-bfe5-45b0-9926-41ef72e44573 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.707064 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f74b8829-ed24-468a-bee6-5db35252619e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:22.722668 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f74b8829-ed24-468a-bee6-5db35252619e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.321843 Aug 02 08:54:22.733317 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 68/117] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:22 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:22.741920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-c9fc14ca-8240-40fd-85db-b33ac1076785 req-306953d8-eb08-42ac-a617-dd3335ff7305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa787e93-b3ba-4022-83c9-b3bf91be48ea", "name": "network-vif-plugged", "status": "completed", "tag": "53ef7d9d-8440-4f6f-8c2f-22ebcc0b6c0b"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:22.757978 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-c9fc14ca-8240-40fd-85db-b33ac1076785 req-306953d8-eb08-42ac-a617-dd3335ff7305 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.758775 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-c9fc14ca-8240-40fd-85db-b33ac1076785 req-306953d8-eb08-42ac-a617-dd3335ff7305 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.782362 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-c9fc14ca-8240-40fd-85db-b33ac1076785 req-306953d8-eb08-42ac-a617-dd3335ff7305 service nova] Creating event network-vif-plugged:53ef7d9d-8440-4f6f-8c2f-22ebcc0b6c0b for instance aa787e93-b3ba-4022-83c9-b3bf91be48ea on hv-cinder-78729 Aug 02 08:54:22.788937 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-c9fc14ca-8240-40fd-85db-b33ac1076785 req-306953d8-eb08-42ac-a617-dd3335ff7305 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061072 Aug 02 08:54:22.791470 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 69/118] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:22.824204 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9c453d8b-464a-40af-b910-41a95a5430c8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:22.824911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9c453d8b-464a-40af-b910-41a95a5430c8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:22.834581 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c453d8b-464a-40af-b910-41a95a5430c8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.835037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c453d8b-464a-40af-b910-41a95a5430c8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.835814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c453d8b-464a-40af-b910-41a95a5430c8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:22.836282 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c453d8b-464a-40af-b910-41a95a5430c8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:22.928586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-13b67e6a-bfe5-45b0-9926-41ef72e44573 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:22.960410 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-13b67e6a-bfe5-45b0-9926-41ef72e44573 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.420659 Aug 02 08:54:22.963491 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 50/119] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:22 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:23.485098 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:23.487535 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:23.499305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:23.501246 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:23.511419 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:23.513944 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:23.655583 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9c453d8b-464a-40af-b910-41a95a5430c8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:23.672009 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9c453d8b-464a-40af-b910-41a95a5430c8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.852570 Aug 02 08:54:23.672263 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 70/120] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:22 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:23.748892 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-26da217f-d72b-40e1-a8e0-f8b23997d695 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:23.750577 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-26da217f-d72b-40e1-a8e0-f8b23997d695 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:23.758478 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-26da217f-d72b-40e1-a8e0-f8b23997d695 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:23.758923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-26da217f-d72b-40e1-a8e0-f8b23997d695 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:23.759705 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-26da217f-d72b-40e1-a8e0-f8b23997d695 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:23.760206 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-26da217f-d72b-40e1-a8e0-f8b23997d695 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:24.022057 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:24.031315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:24.036796 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:24.038145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ccbb44cf-f79f-4f7c-8c08-6d39d97d82c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.562039 Aug 02 08:54:24.041363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 51/121] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:23 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:54:24.046180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f100a573-c474-4ff3-be90-3ea115206bc9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:24.053068 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f100a573-c474-4ff3-be90-3ea115206bc9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:24.060701 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f100a573-c474-4ff3-be90-3ea115206bc9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:24.061411 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f100a573-c474-4ff3-be90-3ea115206bc9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:24.062865 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f100a573-c474-4ff3-be90-3ea115206bc9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:24.063480 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f100a573-c474-4ff3-be90-3ea115206bc9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:24.161352 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-26da217f-d72b-40e1-a8e0-f8b23997d695 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:24.169420 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-26da217f-d72b-40e1-a8e0-f8b23997d695 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.424215 Aug 02 08:54:24.169859 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 71/122] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:23 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:24.507852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f100a573-c474-4ff3-be90-3ea115206bc9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:24.516790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f100a573-c474-4ff3-be90-3ea115206bc9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.474066 Aug 02 08:54:24.539077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 52/123] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:24 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:24.691792 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b02ec118-6275-4651-9ed9-a7f5ded7d91b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:24.692427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b02ec118-6275-4651-9ed9-a7f5ded7d91b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:24.700312 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b02ec118-6275-4651-9ed9-a7f5ded7d91b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:24.700831 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b02ec118-6275-4651-9ed9-a7f5ded7d91b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:24.701633 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b02ec118-6275-4651-9ed9-a7f5ded7d91b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:24.702089 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b02ec118-6275-4651-9ed9-a7f5ded7d91b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:24.830338 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-d27d0bd5-a92a-4015-aa41-5ac3880ce764 req-2627753a-c456-4421-bce4-9cf8b581ce79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bfc599-c1b3-4328-88b1-c8e505562480", "name": "network-vif-plugged", "status": "completed", "tag": "4265e426-406d-4e2d-b009-de8ff72ede37"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:24.842686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-d27d0bd5-a92a-4015-aa41-5ac3880ce764 req-2627753a-c456-4421-bce4-9cf8b581ce79 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:24.844463 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-d27d0bd5-a92a-4015-aa41-5ac3880ce764 req-2627753a-c456-4421-bce4-9cf8b581ce79 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:24.859577 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-d27d0bd5-a92a-4015-aa41-5ac3880ce764 req-2627753a-c456-4421-bce4-9cf8b581ce79 service nova] Creating event network-vif-plugged:4265e426-406d-4e2d-b009-de8ff72ede37 for instance e0bfc599-c1b3-4328-88b1-c8e505562480 on hv-cinder-78729 Aug 02 08:54:24.866302 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-d27d0bd5-a92a-4015-aa41-5ac3880ce764 req-2627753a-c456-4421-bce4-9cf8b581ce79 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059709 Aug 02 08:54:24.867130 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 53/124] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:24.868098 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b02ec118-6275-4651-9ed9-a7f5ded7d91b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:24.880711 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b02ec118-6275-4651-9ed9-a7f5ded7d91b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.193468 Aug 02 08:54:24.881825 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 72/125] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:24 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:25.087864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:25.088924 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:25.099640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:25.100540 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:25.102246 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:25.103240 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:25.193704 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a304821e-9511-41f3-b659-936000b4a1d2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:25.194814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a304821e-9511-41f3-b659-936000b4a1d2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:25.206547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a304821e-9511-41f3-b659-936000b4a1d2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:25.207337 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a304821e-9511-41f3-b659-936000b4a1d2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:25.209196 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a304821e-9511-41f3-b659-936000b4a1d2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:25.209962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a304821e-9511-41f3-b659-936000b4a1d2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:25.328921 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:25.340620 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:25.343237 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:25.345317 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ea3482c1-2ec4-4e98-9f29-b8746972de8c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.264737 Aug 02 08:54:25.361389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 54/126] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:25 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:25.466940 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a304821e-9511-41f3-b659-936000b4a1d2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:25.481231 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a304821e-9511-41f3-b659-936000b4a1d2 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.292459 Aug 02 08:54:25.481369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 73/127] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:25 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:25.562844 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-87371d0a-9ca0-4c22-b994-718cf895efc1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:25.563714 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-87371d0a-9ca0-4c22-b994-718cf895efc1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:25.580706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-87371d0a-9ca0-4c22-b994-718cf895efc1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:25.584233 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-87371d0a-9ca0-4c22-b994-718cf895efc1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:25.585149 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-87371d0a-9ca0-4c22-b994-718cf895efc1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:25.586912 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-87371d0a-9ca0-4c22-b994-718cf895efc1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:25.766881 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-87371d0a-9ca0-4c22-b994-718cf895efc1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:25.775088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-87371d0a-9ca0-4c22-b994-718cf895efc1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.216865 Aug 02 08:54:25.775674 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 55/128] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:25 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:25.904478 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-23e9ad1b-e1e0-428a-a718-f25c1d6020e9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:25.905094 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-23e9ad1b-e1e0-428a-a718-f25c1d6020e9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:25.911354 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-23e9ad1b-e1e0-428a-a718-f25c1d6020e9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:25.911974 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-23e9ad1b-e1e0-428a-a718-f25c1d6020e9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:25.912924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-23e9ad1b-e1e0-428a-a718-f25c1d6020e9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:25.913360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-23e9ad1b-e1e0-428a-a718-f25c1d6020e9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:26.206262 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-23e9ad1b-e1e0-428a-a718-f25c1d6020e9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:26.220001 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-23e9ad1b-e1e0-428a-a718-f25c1d6020e9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.317871 Aug 02 08:54:26.220696 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 74/129] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:25 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:26.373216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:26.374023 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:26.381243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:26.381961 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:26.382901 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:26.383497 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:26.388763 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=100 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:26.503120 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1035bc53-a3ca-4550-9571-6730ca041611 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:26.503824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1035bc53-a3ca-4550-9571-6730ca041611 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:26.526378 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1035bc53-a3ca-4550-9571-6730ca041611 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:26.526930 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1035bc53-a3ca-4550-9571-6730ca041611 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:26.527834 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1035bc53-a3ca-4550-9571-6730ca041611 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:26.528914 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1035bc53-a3ca-4550-9571-6730ca041611 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:26.602306 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:26.611183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:26.613773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:26.615348 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9ea8fe6b-15e1-4991-833b-7c244f5cfcd2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.245756 Aug 02 08:54:26.616443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 56/130] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:26 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:26.799740 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6c64592e-af8b-4c39-a49a-bf3ce2d67511 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:26.800768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6c64592e-af8b-4c39-a49a-bf3ce2d67511 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:26.818427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1035bc53-a3ca-4550-9571-6730ca041611 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:26.822879 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c64592e-af8b-4c39-a49a-bf3ce2d67511 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:26.826175 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c64592e-af8b-4c39-a49a-bf3ce2d67511 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:26.829181 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1035bc53-a3ca-4550-9571-6730ca041611 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.330230 Aug 02 08:54:26.830341 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c64592e-af8b-4c39-a49a-bf3ce2d67511 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:26.831033 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c64592e-af8b-4c39-a49a-bf3ce2d67511 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:26.831377 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 75/131] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:26 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:27.031758 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6c64592e-af8b-4c39-a49a-bf3ce2d67511 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:27.042375 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6c64592e-af8b-4c39-a49a-bf3ce2d67511 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.249708 Aug 02 08:54:27.043371 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 57/132] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:26 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:27.242888 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5aa63409-8372-4266-ba1a-a55fa9bd9417 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:27.249253 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5aa63409-8372-4266-ba1a-a55fa9bd9417 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:27.262720 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5aa63409-8372-4266-ba1a-a55fa9bd9417 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:27.264297 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5aa63409-8372-4266-ba1a-a55fa9bd9417 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:27.266294 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5aa63409-8372-4266-ba1a-a55fa9bd9417 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:27.266852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5aa63409-8372-4266-ba1a-a55fa9bd9417 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:27.458125 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5aa63409-8372-4266-ba1a-a55fa9bd9417 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:27.466933 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5aa63409-8372-4266-ba1a-a55fa9bd9417 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.227752 Aug 02 08:54:27.467663 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 76/133] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:27 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:27.657772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:27.657772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:27.665852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:27.666310 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:27.667099 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:27.667870 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:27.849321 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:27.859545 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:27.861481 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:27.862825 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6772946f-0808-4173-9422-a75c33baf152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.212599 Aug 02 08:54:27.864082 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 58/134] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:27 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:27.865529 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9c765a65-013f-44dd-879f-1e142274e692 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:27.866321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9c765a65-013f-44dd-879f-1e142274e692 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:27.874707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c765a65-013f-44dd-879f-1e142274e692 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:27.875158 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c765a65-013f-44dd-879f-1e142274e692 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:27.875936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c765a65-013f-44dd-879f-1e142274e692 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:27.878784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c765a65-013f-44dd-879f-1e142274e692 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:28.064171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0d7ca255-f71c-4109-9c5b-47d08f61c31e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:28.064937 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0d7ca255-f71c-4109-9c5b-47d08f61c31e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:28.077325 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d7ca255-f71c-4109-9c5b-47d08f61c31e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:28.079694 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d7ca255-f71c-4109-9c5b-47d08f61c31e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:28.079821 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9c765a65-013f-44dd-879f-1e142274e692 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:28.081826 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d7ca255-f71c-4109-9c5b-47d08f61c31e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:28.082921 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d7ca255-f71c-4109-9c5b-47d08f61c31e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:28.090382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9c765a65-013f-44dd-879f-1e142274e692 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.229798 Aug 02 08:54:28.106096 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 77/135] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:27 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:28.366176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-e444ca87-76a5-4bdd-84c9-355bc6452c40 req-dc193ac8-0cfd-4d1d-8091-7f2799f5c1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f9c72f-350b-428c-b020-d16159e0c991", "name": "network-vif-plugged", "status": "completed", "tag": "f3e02b9c-83d3-460c-8aac-b98eba055bb0"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:28.384857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-e444ca87-76a5-4bdd-84c9-355bc6452c40 req-dc193ac8-0cfd-4d1d-8091-7f2799f5c1be service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:28.385548 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-e444ca87-76a5-4bdd-84c9-355bc6452c40 req-dc193ac8-0cfd-4d1d-8091-7f2799f5c1be service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:28.407596 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-e444ca87-76a5-4bdd-84c9-355bc6452c40 req-dc193ac8-0cfd-4d1d-8091-7f2799f5c1be service nova] Creating event network-vif-plugged:f3e02b9c-83d3-460c-8aac-b98eba055bb0 for instance b1f9c72f-350b-428c-b020-d16159e0c991 on hv-cinder-78729 Aug 02 08:54:28.414326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-e444ca87-76a5-4bdd-84c9-355bc6452c40 req-dc193ac8-0cfd-4d1d-8091-7f2799f5c1be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054400 Aug 02 08:54:28.415410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 78/136] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:54:28.428054 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0d7ca255-f71c-4109-9c5b-47d08f61c31e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:28.449008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0d7ca255-f71c-4109-9c5b-47d08f61c31e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.382674 Aug 02 08:54:28.450309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 59/137] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:28 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:28.491926 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2656b9a0-4b46-4319-9672-3501cfb63779 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:28.493645 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-2656b9a0-4b46-4319-9672-3501cfb63779 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:28.502859 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2656b9a0-4b46-4319-9672-3501cfb63779 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:28.503478 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2656b9a0-4b46-4319-9672-3501cfb63779 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:28.504663 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2656b9a0-4b46-4319-9672-3501cfb63779 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:28.505362 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2656b9a0-4b46-4319-9672-3501cfb63779 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:28.734997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2656b9a0-4b46-4319-9672-3501cfb63779 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:28.745360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-2656b9a0-4b46-4319-9672-3501cfb63779 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1322 microversion: 2.1 time: 0.259897 Aug 02 08:54:28.759654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 79/138] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:28 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:28.887578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:28.889036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:28.902975 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:28.903704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:28.904533 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:28.906541 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:29.111671 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1b00f5d3-6a69-4da3-a558-148491009c4b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:29.112415 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1b00f5d3-6a69-4da3-a558-148491009c4b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:29.119010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b00f5d3-6a69-4da3-a558-148491009c4b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:29.136939 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b00f5d3-6a69-4da3-a558-148491009c4b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:29.143348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b00f5d3-6a69-4da3-a558-148491009c4b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:29.144642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b00f5d3-6a69-4da3-a558-148491009c4b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:29.239839 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:29.253039 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:29.258126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:29.259812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-18699d61-1587-492a-b88e-e6dfa18c19b6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.377059 Aug 02 08:54:29.268484 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 60/139] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:28 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:29.445947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1b00f5d3-6a69-4da3-a558-148491009c4b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:29.453622 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1b00f5d3-6a69-4da3-a558-148491009c4b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.346335 Aug 02 08:54:29.455364 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 80/140] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:29 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:29.473042 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e7f0ebee-e1c6-4508-8a70-9e233f1a6702 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:29.473777 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e7f0ebee-e1c6-4508-8a70-9e233f1a6702 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:29.483152 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e7f0ebee-e1c6-4508-8a70-9e233f1a6702 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:29.485220 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e7f0ebee-e1c6-4508-8a70-9e233f1a6702 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:29.489531 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e7f0ebee-e1c6-4508-8a70-9e233f1a6702 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:29.491474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e7f0ebee-e1c6-4508-8a70-9e233f1a6702 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:29.767841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-de8e4c12-8ac9-480b-b375-7c4ef9ec1941 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:29.768495 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-de8e4c12-8ac9-480b-b375-7c4ef9ec1941 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:29.778659 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-de8e4c12-8ac9-480b-b375-7c4ef9ec1941 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:29.779119 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-de8e4c12-8ac9-480b-b375-7c4ef9ec1941 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:29.782053 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-de8e4c12-8ac9-480b-b375-7c4ef9ec1941 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:29.782541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-de8e4c12-8ac9-480b-b375-7c4ef9ec1941 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.007978 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e7f0ebee-e1c6-4508-8a70-9e233f1a6702 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:30.019145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e7f0ebee-e1c6-4508-8a70-9e233f1a6702 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.549795 Aug 02 08:54:30.020061 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 61/141] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:29 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:30.131220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-de8e4c12-8ac9-480b-b375-7c4ef9ec1941 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:30.142968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-de8e4c12-8ac9-480b-b375-7c4ef9ec1941 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1515 microversion: 2.1 time: 0.379801 Aug 02 08:54:30.152931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 81/142] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:29 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1515 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:30.175256 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-12172cd4-db38-4bbe-a03c-877fd8aeb493 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:30.177318 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-12172cd4-db38-4bbe-a03c-877fd8aeb493 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:30.189390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12172cd4-db38-4bbe-a03c-877fd8aeb493 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.189841 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12172cd4-db38-4bbe-a03c-877fd8aeb493 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.190625 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12172cd4-db38-4bbe-a03c-877fd8aeb493 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.191063 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12172cd4-db38-4bbe-a03c-877fd8aeb493 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.287273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:30.287878 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:30.295528 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.295987 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.296832 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.297277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.304736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-12172cd4-db38-4bbe-a03c-877fd8aeb493 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lazy-loading 'flavor' on Instance uuid aa787e93-b3ba-4022-83c9-b3bf91be48ea {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:54:30.323408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=100 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:30.504971 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-12172cd4-db38-4bbe-a03c-877fd8aeb493 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea/action" status: 200 len: 32 microversion: 2.1 time: 0.333485 Aug 02 08:54:30.505818 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 62/143] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 08:54:30 2022] POST /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 08:54:30.521509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-29fb43e2-8665-4f95-95b8-91dbb185bcd7 req-01e3cc80-7501-43c6-99a4-fd89f43d3560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92713a6-b49a-4dd4-b944-0d370dd4326d", "name": "network-vif-plugged", "status": "completed", "tag": "095a6c69-d447-4b1f-90e1-70752ef97699"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:30.536922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-29fb43e2-8665-4f95-95b8-91dbb185bcd7 req-01e3cc80-7501-43c6-99a4-fd89f43d3560 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.537755 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-29fb43e2-8665-4f95-95b8-91dbb185bcd7 req-01e3cc80-7501-43c6-99a4-fd89f43d3560 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.554668 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-29fb43e2-8665-4f95-95b8-91dbb185bcd7 req-01e3cc80-7501-43c6-99a4-fd89f43d3560 service nova] Creating event network-vif-plugged:095a6c69-d447-4b1f-90e1-70752ef97699 for instance a92713a6-b49a-4dd4-b944-0d370dd4326d on hv-cinder-78729 Aug 02 08:54:30.554883 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:30.559675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-29fb43e2-8665-4f95-95b8-91dbb185bcd7 req-01e3cc80-7501-43c6-99a4-fd89f43d3560 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045212 Aug 02 08:54:30.562665 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 63/144] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:30.568722 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6596898b-acdc-45a1-9852-5827a14fc13e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:30.570101 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6596898b-acdc-45a1-9852-5827a14fc13e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:30.578424 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6596898b-acdc-45a1-9852-5827a14fc13e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.578927 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6596898b-acdc-45a1-9852-5827a14fc13e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.579699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6596898b-acdc-45a1-9852-5827a14fc13e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.580337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6596898b-acdc-45a1-9852-5827a14fc13e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.586685 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:30.588394 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:30.591654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ad3f012a-3aa9-49c4-b616-f2d99952fc42 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.307453 Aug 02 08:54:30.609853 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 82/145] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:30 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:54:30.615648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-dcc60f50-3db8-4122-9d3a-ef5043510527 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:30.622354 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-dcc60f50-3db8-4122-9d3a-ef5043510527 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:30.629308 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dcc60f50-3db8-4122-9d3a-ef5043510527 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.629944 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dcc60f50-3db8-4122-9d3a-ef5043510527 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.630654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dcc60f50-3db8-4122-9d3a-ef5043510527 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:30.631090 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dcc60f50-3db8-4122-9d3a-ef5043510527 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:30.774839 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6596898b-acdc-45a1-9852-5827a14fc13e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:30.786471 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6596898b-acdc-45a1-9852-5827a14fc13e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1314 microversion: 2.1 time: 0.220437 Aug 02 08:54:30.800230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 64/146] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:30 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:30.886471 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-dcc60f50-3db8-4122-9d3a-ef5043510527 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:30.896012 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-dcc60f50-3db8-4122-9d3a-ef5043510527 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.284519 Aug 02 08:54:30.896921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 83/147] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:30 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:31.053015 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-aeb802b0-f097-4d31-9976-fc0e2a746d13 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:31.053687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-aeb802b0-f097-4d31-9976-fc0e2a746d13 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:31.062720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aeb802b0-f097-4d31-9976-fc0e2a746d13 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:31.063432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aeb802b0-f097-4d31-9976-fc0e2a746d13 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:31.064385 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aeb802b0-f097-4d31-9976-fc0e2a746d13 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:31.064992 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aeb802b0-f097-4d31-9976-fc0e2a746d13 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:31.236990 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-aeb802b0-f097-4d31-9976-fc0e2a746d13 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:31.256605 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-aeb802b0-f097-4d31-9976-fc0e2a746d13 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.211161 Aug 02 08:54:31.268494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 65/148] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:31 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:31.629353 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:31.630836 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:31.643838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:31.644619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:31.645466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:31.645907 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:31.814595 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6d34ed07-a559-4694-b9cb-63b169757fff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:31.815205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6d34ed07-a559-4694-b9cb-63b169757fff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:31.822608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d34ed07-a559-4694-b9cb-63b169757fff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:31.823479 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d34ed07-a559-4694-b9cb-63b169757fff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:31.824483 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d34ed07-a559-4694-b9cb-63b169757fff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:31.825434 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d34ed07-a559-4694-b9cb-63b169757fff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:31.839996 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:31.855445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:31.860953 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:31.866323 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-666e036b-d9e6-4b22-8cb1-cd03cc9d7b43 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.244963 Aug 02 08:54:31.885079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 84/149] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:31 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:31.920773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f5ce5f1f-91b0-47ce-84c8-cc9eee8226ee tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:31.921933 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f5ce5f1f-91b0-47ce-84c8-cc9eee8226ee tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:31.933106 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5ce5f1f-91b0-47ce-84c8-cc9eee8226ee tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:31.933664 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5ce5f1f-91b0-47ce-84c8-cc9eee8226ee tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:31.937853 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5ce5f1f-91b0-47ce-84c8-cc9eee8226ee tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:31.938299 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5ce5f1f-91b0-47ce-84c8-cc9eee8226ee tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:32.029080 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6d34ed07-a559-4694-b9cb-63b169757fff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:32.041694 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6d34ed07-a559-4694-b9cb-63b169757fff tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1501 microversion: 2.1 time: 0.232556 Aug 02 08:54:32.059180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 66/150] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:31 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:32.247249 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f5ce5f1f-91b0-47ce-84c8-cc9eee8226ee tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:32.258690 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f5ce5f1f-91b0-47ce-84c8-cc9eee8226ee tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.345609 Aug 02 08:54:32.259925 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 85/151] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:31 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:32.284421 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-999440b1-b2ba-4d8f-941a-46ae7eaf238b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:32.285354 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-999440b1-b2ba-4d8f-941a-46ae7eaf238b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:32.294721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-999440b1-b2ba-4d8f-941a-46ae7eaf238b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:32.295177 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-999440b1-b2ba-4d8f-941a-46ae7eaf238b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:32.299016 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-999440b1-b2ba-4d8f-941a-46ae7eaf238b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:32.305633 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-999440b1-b2ba-4d8f-941a-46ae7eaf238b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:32.484500 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-999440b1-b2ba-4d8f-941a-46ae7eaf238b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:32.495213 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-999440b1-b2ba-4d8f-941a-46ae7eaf238b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.215840 Aug 02 08:54:32.496341 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 67/152] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:32 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:32.892918 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:32.893515 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:32.900266 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:32.900782 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:32.901784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:32.902406 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:33.055980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:33.064865 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:33.073559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:33.075274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0091fbcd-69a2-4846-acec-cabbe9b9afdd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.186611 Aug 02 08:54:33.076559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 86/153] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:32 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:33.281821 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e72d3435-4fc3-454a-ad38-311895092473 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:33.282436 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e72d3435-4fc3-454a-ad38-311895092473 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:33.292368 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e72d3435-4fc3-454a-ad38-311895092473 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:33.292824 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e72d3435-4fc3-454a-ad38-311895092473 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:33.295205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e72d3435-4fc3-454a-ad38-311895092473 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:33.295536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e72d3435-4fc3-454a-ad38-311895092473 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:33.490430 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e72d3435-4fc3-454a-ad38-311895092473 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:33.499227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e72d3435-4fc3-454a-ad38-311895092473 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.221833 Aug 02 08:54:33.502107 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 68/154] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:33 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:33.524046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f5f5de68-c3d5-4104-8015-23d22781c273 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:33.524933 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f5f5de68-c3d5-4104-8015-23d22781c273 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:33.532196 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5f5de68-c3d5-4104-8015-23d22781c273 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:33.532639 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5f5de68-c3d5-4104-8015-23d22781c273 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:33.533546 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5f5de68-c3d5-4104-8015-23d22781c273 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:33.533982 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5f5de68-c3d5-4104-8015-23d22781c273 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:33.882372 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f5f5de68-c3d5-4104-8015-23d22781c273 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:33.891823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f5f5de68-c3d5-4104-8015-23d22781c273 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.376745 Aug 02 08:54:33.892441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 87/155] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:33 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:34.099618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:34.100273 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:34.106391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:34.106844 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:34.107615 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:34.108053 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:34.253955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:34.262286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:34.263822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:34.265465 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-354d174e-5893-44b8-aae9-d460d7c21e90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.169446 Aug 02 08:54:34.266031 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 69/156] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:34 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:34.534050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1ee79645-db30-4bb4-bc83-d5d887990367 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:34.534683 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1ee79645-db30-4bb4-bc83-d5d887990367 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:34.540894 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1ee79645-db30-4bb4-bc83-d5d887990367 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:34.541681 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1ee79645-db30-4bb4-bc83-d5d887990367 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:34.542464 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1ee79645-db30-4bb4-bc83-d5d887990367 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:34.542902 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1ee79645-db30-4bb4-bc83-d5d887990367 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:34.679606 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1ee79645-db30-4bb4-bc83-d5d887990367 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:34.687798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1ee79645-db30-4bb4-bc83-d5d887990367 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.157567 Aug 02 08:54:34.688419 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 88/157] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:34 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:34.912050 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e1f0c5b5-c4c7-40f0-bc5a-511478be35d7 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:34.912684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e1f0c5b5-c4c7-40f0-bc5a-511478be35d7 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:34.918831 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e1f0c5b5-c4c7-40f0-bc5a-511478be35d7 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:34.919277 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e1f0c5b5-c4c7-40f0-bc5a-511478be35d7 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:34.920039 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e1f0c5b5-c4c7-40f0-bc5a-511478be35d7 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:34.920496 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e1f0c5b5-c4c7-40f0-bc5a-511478be35d7 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:35.051729 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e1f0c5b5-c4c7-40f0-bc5a-511478be35d7 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:35.063251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e1f0c5b5-c4c7-40f0-bc5a-511478be35d7 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.154935 Aug 02 08:54:35.063833 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 70/158] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:34 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:35.290336 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:35.290955 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:35.297743 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:35.298188 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:35.298952 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:35.299418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:35.450358 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:35.458778 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:35.460303 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:35.461401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ef8a3427-29fa-4f7c-ba82-b7977e142e70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.175038 Aug 02 08:54:35.461956 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 89/159] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:35 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:35.708841 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2eda72c8-189a-4538-ae95-60eca4de08fd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:35.709450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2eda72c8-189a-4538-ae95-60eca4de08fd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:35.715743 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2eda72c8-189a-4538-ae95-60eca4de08fd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:35.716238 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2eda72c8-189a-4538-ae95-60eca4de08fd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:35.717088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2eda72c8-189a-4538-ae95-60eca4de08fd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:35.717544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2eda72c8-189a-4538-ae95-60eca4de08fd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:35.737361 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:35.881579 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2eda72c8-189a-4538-ae95-60eca4de08fd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:35.890307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2eda72c8-189a-4538-ae95-60eca4de08fd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.185193 Aug 02 08:54:35.890908 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 71/160] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:35 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:36.087323 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-576a3255-05e3-4484-bf11-093e68609c60 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:36.087835 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-576a3255-05e3-4484-bf11-093e68609c60 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:36.095572 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-576a3255-05e3-4484-bf11-093e68609c60 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:36.096022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-576a3255-05e3-4484-bf11-093e68609c60 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:36.096857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-576a3255-05e3-4484-bf11-093e68609c60 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:36.097294 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-576a3255-05e3-4484-bf11-093e68609c60 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:36.231032 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-576a3255-05e3-4484-bf11-093e68609c60 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:36.238647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-576a3255-05e3-4484-bf11-093e68609c60 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.155255 Aug 02 08:54:36.239214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 90/161] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:36 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:36.485334 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:36.485871 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:36.491834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:36.492329 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:36.493094 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:36.493523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:36.634047 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:36.642083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:36.643592 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:36.644729 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-48880fc1-beb7-43b7-a9aa-50d4e9173265 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1407 microversion: 2.20 time: 0.163504 Aug 02 08:54:36.645298 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 72/162] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:36 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:36.911536 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0c99311e-e5f2-4f35-a7af-805769e5619f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:36.912313 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0c99311e-e5f2-4f35-a7af-805769e5619f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:36.919528 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0c99311e-e5f2-4f35-a7af-805769e5619f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:36.919980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0c99311e-e5f2-4f35-a7af-805769e5619f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:36.920799 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0c99311e-e5f2-4f35-a7af-805769e5619f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:36.921233 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0c99311e-e5f2-4f35-a7af-805769e5619f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:37.080974 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0c99311e-e5f2-4f35-a7af-805769e5619f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:37.089291 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0c99311e-e5f2-4f35-a7af-805769e5619f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.181714 Aug 02 08:54:37.090082 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 91/163] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:36 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:37.259928 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-34d5c7b0-3905-425a-991e-01b81227af4a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:37.260566 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-34d5c7b0-3905-425a-991e-01b81227af4a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:37.262500 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=90 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:37.268684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-34d5c7b0-3905-425a-991e-01b81227af4a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:37.269141 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-34d5c7b0-3905-425a-991e-01b81227af4a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:37.269929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-34d5c7b0-3905-425a-991e-01b81227af4a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:37.270375 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-34d5c7b0-3905-425a-991e-01b81227af4a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:37.399499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-34d5c7b0-3905-425a-991e-01b81227af4a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:37.406940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-34d5c7b0-3905-425a-991e-01b81227af4a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.150899 Aug 02 08:54:37.408145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 73/164] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:37 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:37.667283 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:37.668043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:37.680458 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:37.680858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:37.694863 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:37.695688 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:37.867647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:37.878616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:37.881021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:37.882598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-415011e2-699c-4a51-8ded-8a5406218dfe tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1599 microversion: 2.20 time: 0.219533 Aug 02 08:54:37.883254 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 92/165] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:54:37 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:54:37.906589 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-368db27e-913c-4ad8-84ad-e6f8340c88e5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:37.907755 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-368db27e-913c-4ad8-84ad-e6f8340c88e5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:37.916095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-368db27e-913c-4ad8-84ad-e6f8340c88e5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:37.916947 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-368db27e-913c-4ad8-84ad-e6f8340c88e5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:37.917932 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-368db27e-913c-4ad8-84ad-e6f8340c88e5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:37.918566 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-368db27e-913c-4ad8-84ad-e6f8340c88e5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:38.010171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-368db27e-913c-4ad8-84ad-e6f8340c88e5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107459 Aug 02 08:54:38.011278 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 74/166] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Aug 2 08:54:37 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:54:38.059559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-25b92029-9aa1-4236-a71a-736aa1c10c52 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46b0b169-4a41-4208-ab05-d952043b1ed4"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:38.064465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-25b92029-9aa1-4236-a71a-736aa1c10c52 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:38.077014 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-25b92029-9aa1-4236-a71a-736aa1c10c52 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:38.077709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-25b92029-9aa1-4236-a71a-736aa1c10c52 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:38.079030 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-25b92029-9aa1-4236-a71a-736aa1c10c52 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:38.079652 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-25b92029-9aa1-4236-a71a-736aa1c10c52 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:38.112304 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3d811de5-3825-48d4-abcb-998ae9f81933 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:38.112956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3d811de5-3825-48d4-abcb-998ae9f81933 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:38.134385 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3d811de5-3825-48d4-abcb-998ae9f81933 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:38.138348 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3d811de5-3825-48d4-abcb-998ae9f81933 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:38.140096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3d811de5-3825-48d4-abcb-998ae9f81933 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:38.140567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3d811de5-3825-48d4-abcb-998ae9f81933 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:38.340071 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3d811de5-3825-48d4-abcb-998ae9f81933 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:38.347610 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3d811de5-3825-48d4-abcb-998ae9f81933 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.240339 Aug 02 08:54:38.348209 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 75/167] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:38 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:38.437234 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2504e465-76fa-4434-8f28-1ff9090027a0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:38.437793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2504e465-76fa-4434-8f28-1ff9090027a0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:38.443980 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2504e465-76fa-4434-8f28-1ff9090027a0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:38.444465 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2504e465-76fa-4434-8f28-1ff9090027a0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:38.445234 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2504e465-76fa-4434-8f28-1ff9090027a0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:38.445670 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2504e465-76fa-4434-8f28-1ff9090027a0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:38.595127 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2504e465-76fa-4434-8f28-1ff9090027a0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:38.602635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2504e465-76fa-4434-8f28-1ff9090027a0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.169379 Aug 02 08:54:38.603213 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 76/168] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:38 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:39.369113 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b4f655cc-1ad9-4171-9165-b7323ac5cbb7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:39.369775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b4f655cc-1ad9-4171-9165-b7323ac5cbb7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:39.382375 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4f655cc-1ad9-4171-9165-b7323ac5cbb7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:39.383380 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4f655cc-1ad9-4171-9165-b7323ac5cbb7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:39.384438 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4f655cc-1ad9-4171-9165-b7323ac5cbb7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:39.385569 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4f655cc-1ad9-4171-9165-b7323ac5cbb7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:39.627263 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b4f655cc-1ad9-4171-9165-b7323ac5cbb7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:39.639168 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b4f655cc-1ad9-4171-9165-b7323ac5cbb7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.273921 Aug 02 08:54:39.640385 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 77/169] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:39 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:39.648609 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-fe56092a-0a27-4352-a727-e5539ea4f53b req-96ac0935-0ec6-4b66-b8d5-2d518308153d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f9c72f-350b-428c-b020-d16159e0c991", "tag": "f3e02b9c-83d3-460c-8aac-b98eba055bb0"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:39.665792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-fe56092a-0a27-4352-a727-e5539ea4f53b req-96ac0935-0ec6-4b66-b8d5-2d518308153d service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:39.666532 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-fe56092a-0a27-4352-a727-e5539ea4f53b req-96ac0935-0ec6-4b66-b8d5-2d518308153d service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:39.681808 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-fe56092a-0a27-4352-a727-e5539ea4f53b req-96ac0935-0ec6-4b66-b8d5-2d518308153d service nova] Creating event network-changed:f3e02b9c-83d3-460c-8aac-b98eba055bb0 for instance b1f9c72f-350b-428c-b020-d16159e0c991 on hv-cinder-78729 Aug 02 08:54:39.688435 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-fe56092a-0a27-4352-a727-e5539ea4f53b req-96ac0935-0ec6-4b66-b8d5-2d518308153d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043219 Aug 02 08:54:39.689042 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 78/170] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:39.694526 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2984483e-34b9-4c72-a0c0-d0d41c4b355a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:39.695228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2984483e-34b9-4c72-a0c0-d0d41c4b355a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:39.702084 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2984483e-34b9-4c72-a0c0-d0d41c4b355a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:39.702600 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2984483e-34b9-4c72-a0c0-d0d41c4b355a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:39.703301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2984483e-34b9-4c72-a0c0-d0d41c4b355a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:39.703704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2984483e-34b9-4c72-a0c0-d0d41c4b355a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:39.864266 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-25b92029-9aa1-4236-a71a-736aa1c10c52 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "POST /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.810383 Aug 02 08:54:39.865810 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 93/171] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 08:54:38 2022] POST /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480/os-volume_attachments => generated 194 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:39.935089 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2984483e-34b9-4c72-a0c0-d0d41c4b355a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:39.945051 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2984483e-34b9-4c72-a0c0-d0d41c4b355a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1362 microversion: 2.1 time: 0.254078 Aug 02 08:54:39.945873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 79/172] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:39 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:40.663823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f0b13938-6f3e-4fef-baa6-286a53c748af tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:40.664665 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f0b13938-6f3e-4fef-baa6-286a53c748af tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:40.671812 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0b13938-6f3e-4fef-baa6-286a53c748af tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:40.672399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0b13938-6f3e-4fef-baa6-286a53c748af tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:40.673236 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0b13938-6f3e-4fef-baa6-286a53c748af tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:40.673769 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0b13938-6f3e-4fef-baa6-286a53c748af tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:40.864444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f0b13938-6f3e-4fef-baa6-286a53c748af tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:40.878230 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f0b13938-6f3e-4fef-baa6-286a53c748af tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.218982 Aug 02 08:54:40.890941 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 94/173] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:40 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:40.969549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6c5d6773-e5fb-4c22-a1fc-59f66fe0d2c9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:40.972422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6c5d6773-e5fb-4c22-a1fc-59f66fe0d2c9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:40.987367 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6773-e5fb-4c22-a1fc-59f66fe0d2c9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:40.989825 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6773-e5fb-4c22-a1fc-59f66fe0d2c9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:40.990950 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6773-e5fb-4c22-a1fc-59f66fe0d2c9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:40.991855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c5d6773-e5fb-4c22-a1fc-59f66fe0d2c9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:41.146012 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6c5d6773-e5fb-4c22-a1fc-59f66fe0d2c9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:41.154506 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6c5d6773-e5fb-4c22-a1fc-59f66fe0d2c9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1548 microversion: 2.1 time: 0.191061 Aug 02 08:54:41.155271 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 80/174] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:40 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1548 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:41.176075 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e1321d58-9177-4c92-8e49-be6f050f3835 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:41.176598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e1321d58-9177-4c92-8e49-be6f050f3835 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:41.182807 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e1321d58-9177-4c92-8e49-be6f050f3835 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:41.183278 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e1321d58-9177-4c92-8e49-be6f050f3835 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:41.184005 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e1321d58-9177-4c92-8e49-be6f050f3835 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:41.184465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e1321d58-9177-4c92-8e49-be6f050f3835 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:41.261222 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e1321d58-9177-4c92-8e49-be6f050f3835 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089447 Aug 02 08:54:41.261819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 95/175] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 2 08:54:41 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:41.898827 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-09bc7f20-e3b4-4571-8f65-e8ff912b7d29 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:41.899370 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-09bc7f20-e3b4-4571-8f65-e8ff912b7d29 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:41.906574 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-09bc7f20-e3b4-4571-8f65-e8ff912b7d29 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:41.907025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-09bc7f20-e3b4-4571-8f65-e8ff912b7d29 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:41.907861 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-09bc7f20-e3b4-4571-8f65-e8ff912b7d29 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:41.908338 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-09bc7f20-e3b4-4571-8f65-e8ff912b7d29 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:42.047643 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-09bc7f20-e3b4-4571-8f65-e8ff912b7d29 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:42.056382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-09bc7f20-e3b4-4571-8f65-e8ff912b7d29 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.161400 Aug 02 08:54:42.056996 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 81/176] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:41 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:42.220092 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-ccae65d8-d9e0-4546-877a-d07d8139bd35 req-571056ab-ea3d-4f94-b8d8-6892134a990f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92713a6-b49a-4dd4-b944-0d370dd4326d", "tag": "095a6c69-d447-4b1f-90e1-70752ef97699"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:54:42.224946 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=89 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:42.230812 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-ccae65d8-d9e0-4546-877a-d07d8139bd35 req-571056ab-ea3d-4f94-b8d8-6892134a990f service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:42.231258 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-ccae65d8-d9e0-4546-877a-d07d8139bd35 req-571056ab-ea3d-4f94-b8d8-6892134a990f service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:42.244050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-ccae65d8-d9e0-4546-877a-d07d8139bd35 req-571056ab-ea3d-4f94-b8d8-6892134a990f service nova] Creating event network-changed:095a6c69-d447-4b1f-90e1-70752ef97699 for instance a92713a6-b49a-4dd4-b944-0d370dd4326d on hv-cinder-78729 Aug 02 08:54:42.250722 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-ccae65d8-d9e0-4546-877a-d07d8139bd35 req-571056ab-ea3d-4f94-b8d8-6892134a990f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035447 Aug 02 08:54:42.251506 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 96/177] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:54:43.080431 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-26ee7fbf-1ffe-41c1-ad4f-7decf5309323 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:43.081054 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-26ee7fbf-1ffe-41c1-ad4f-7decf5309323 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:43.088005 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26ee7fbf-1ffe-41c1-ad4f-7decf5309323 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:43.088822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26ee7fbf-1ffe-41c1-ad4f-7decf5309323 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:43.089684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26ee7fbf-1ffe-41c1-ad4f-7decf5309323 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:43.090198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26ee7fbf-1ffe-41c1-ad4f-7decf5309323 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:43.234578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-26ee7fbf-1ffe-41c1-ad4f-7decf5309323 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:43.242611 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-26ee7fbf-1ffe-41c1-ad4f-7decf5309323 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.169432 Aug 02 08:54:43.243289 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 82/178] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:43 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:44.271204 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6dcf7d31-eb3d-4c8d-96cd-90e0847646b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:44.271903 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6dcf7d31-eb3d-4c8d-96cd-90e0847646b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:44.279076 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6dcf7d31-eb3d-4c8d-96cd-90e0847646b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:44.279521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6dcf7d31-eb3d-4c8d-96cd-90e0847646b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:44.280326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6dcf7d31-eb3d-4c8d-96cd-90e0847646b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:44.281339 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6dcf7d31-eb3d-4c8d-96cd-90e0847646b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:44.428413 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6dcf7d31-eb3d-4c8d-96cd-90e0847646b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:44.437434 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6dcf7d31-eb3d-4c8d-96cd-90e0847646b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.170066 Aug 02 08:54:44.438030 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 97/179] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:44 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:45.463693 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a6ba2025-ad82-4f3d-9659-33e44fd6bba1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:45.464373 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a6ba2025-ad82-4f3d-9659-33e44fd6bba1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:45.472310 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a6ba2025-ad82-4f3d-9659-33e44fd6bba1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:45.472797 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a6ba2025-ad82-4f3d-9659-33e44fd6bba1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:45.473591 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a6ba2025-ad82-4f3d-9659-33e44fd6bba1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:45.474068 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a6ba2025-ad82-4f3d-9659-33e44fd6bba1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:45.686983 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a6ba2025-ad82-4f3d-9659-33e44fd6bba1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:45.695454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a6ba2025-ad82-4f3d-9659-33e44fd6bba1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.238796 Aug 02 08:54:45.696041 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 83/180] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:45 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:46.717059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5d3dc79e-f2c9-417b-a0ad-cf9dbb585668 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:46.717828 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5d3dc79e-f2c9-417b-a0ad-cf9dbb585668 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:46.726379 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5d3dc79e-f2c9-417b-a0ad-cf9dbb585668 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:46.726881 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5d3dc79e-f2c9-417b-a0ad-cf9dbb585668 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:46.727905 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5d3dc79e-f2c9-417b-a0ad-cf9dbb585668 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:46.728757 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5d3dc79e-f2c9-417b-a0ad-cf9dbb585668 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:46.901142 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5d3dc79e-f2c9-417b-a0ad-cf9dbb585668 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:46.904873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:46.910775 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5d3dc79e-f2c9-417b-a0ad-cf9dbb585668 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.197470 Aug 02 08:54:46.922868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 98/181] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:46 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:47.933238 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fe2f43f9-81cf-4138-acc7-1e8a8e5825ff tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:47.934245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fe2f43f9-81cf-4138-acc7-1e8a8e5825ff tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:47.946231 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fe2f43f9-81cf-4138-acc7-1e8a8e5825ff tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:47.946689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fe2f43f9-81cf-4138-acc7-1e8a8e5825ff tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:47.947539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fe2f43f9-81cf-4138-acc7-1e8a8e5825ff tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:47.948008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fe2f43f9-81cf-4138-acc7-1e8a8e5825ff tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:48.128799 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fe2f43f9-81cf-4138-acc7-1e8a8e5825ff tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:48.136852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fe2f43f9-81cf-4138-acc7-1e8a8e5825ff tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.209064 Aug 02 08:54:48.137443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 84/182] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:47 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:49.161075 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8cd61721-2660-4496-a95f-4acc32cdd9ae tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:49.162680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8cd61721-2660-4496-a95f-4acc32cdd9ae tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:49.172386 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8cd61721-2660-4496-a95f-4acc32cdd9ae tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:49.173122 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8cd61721-2660-4496-a95f-4acc32cdd9ae tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:49.174169 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8cd61721-2660-4496-a95f-4acc32cdd9ae tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:49.174750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8cd61721-2660-4496-a95f-4acc32cdd9ae tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:49.353416 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8cd61721-2660-4496-a95f-4acc32cdd9ae tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:49.362829 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8cd61721-2660-4496-a95f-4acc32cdd9ae tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.208587 Aug 02 08:54:49.376312 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 99/183] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:49 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:50.384866 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c1c6b089-0845-4381-89a6-4d569dcfb419 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:50.385395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c1c6b089-0845-4381-89a6-4d569dcfb419 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:50.392935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c1c6b089-0845-4381-89a6-4d569dcfb419 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:50.393595 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c1c6b089-0845-4381-89a6-4d569dcfb419 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:50.394534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c1c6b089-0845-4381-89a6-4d569dcfb419 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:50.395430 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c1c6b089-0845-4381-89a6-4d569dcfb419 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:50.614938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c1c6b089-0845-4381-89a6-4d569dcfb419 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:50.622371 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c1c6b089-0845-4381-89a6-4d569dcfb419 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.243431 Aug 02 08:54:50.636295 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 85/184] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:50 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:51.643868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-220e8188-6bb7-44bc-898a-00c11c55745a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:51.645242 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-220e8188-6bb7-44bc-898a-00c11c55745a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:51.652723 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-220e8188-6bb7-44bc-898a-00c11c55745a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:51.653470 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-220e8188-6bb7-44bc-898a-00c11c55745a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:51.654607 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-220e8188-6bb7-44bc-898a-00c11c55745a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:51.655441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-220e8188-6bb7-44bc-898a-00c11c55745a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:51.809931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-220e8188-6bb7-44bc-898a-00c11c55745a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:51.823043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-220e8188-6bb7-44bc-898a-00c11c55745a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.183892 Aug 02 08:54:51.823625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 100/185] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:51 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:52.844819 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-acacf4c2-d9c7-40aa-a738-57f23d2ce8b0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:52.845431 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-acacf4c2-d9c7-40aa-a738-57f23d2ce8b0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:52.852830 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-acacf4c2-d9c7-40aa-a738-57f23d2ce8b0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:52.853274 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-acacf4c2-d9c7-40aa-a738-57f23d2ce8b0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:52.859128 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-acacf4c2-d9c7-40aa-a738-57f23d2ce8b0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:52.859567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-acacf4c2-d9c7-40aa-a738-57f23d2ce8b0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:53.068348 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-acacf4c2-d9c7-40aa-a738-57f23d2ce8b0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:53.082204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-acacf4c2-d9c7-40aa-a738-57f23d2ce8b0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.241219 Aug 02 08:54:53.096460 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 86/186] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:52 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:54.108779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-dc686cab-fc40-423b-8a79-7c0a88342f8a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:54.110441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-dc686cab-fc40-423b-8a79-7c0a88342f8a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:54.121509 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dc686cab-fc40-423b-8a79-7c0a88342f8a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:54.122621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dc686cab-fc40-423b-8a79-7c0a88342f8a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:54.123998 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dc686cab-fc40-423b-8a79-7c0a88342f8a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:54.124781 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dc686cab-fc40-423b-8a79-7c0a88342f8a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:54.298153 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-dc686cab-fc40-423b-8a79-7c0a88342f8a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:54.305734 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-dc686cab-fc40-423b-8a79-7c0a88342f8a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.206204 Aug 02 08:54:54.319818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 101/187] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:54 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:55.253424 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-33e685c7-2c73-4b3b-9cfc-df35a11d139e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:55.253983 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-33e685c7-2c73-4b3b-9cfc-df35a11d139e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:55.260095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-33e685c7-2c73-4b3b-9cfc-df35a11d139e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:55.260578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-33e685c7-2c73-4b3b-9cfc-df35a11d139e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:55.261337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-33e685c7-2c73-4b3b-9cfc-df35a11d139e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:55.261899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-33e685c7-2c73-4b3b-9cfc-df35a11d139e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:55.289330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-33e685c7-2c73-4b3b-9cfc-df35a11d139e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:54:55.327111 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2723c59a-af18-46be-99b5-163630b6a5a2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:55.327820 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-2723c59a-af18-46be-99b5-163630b6a5a2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:55.335158 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2723c59a-af18-46be-99b5-163630b6a5a2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:55.335939 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2723c59a-af18-46be-99b5-163630b6a5a2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:55.337008 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2723c59a-af18-46be-99b5-163630b6a5a2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:55.337506 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2723c59a-af18-46be-99b5-163630b6a5a2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:55.371768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:54:55.435785 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-33e685c7-2c73-4b3b-9cfc-df35a11d139e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 204 len: 0 microversion: 2.1 time: 0.186272 Aug 02 08:54:55.436645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 87/188] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 08:54:55 2022] DELETE /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 08:54:55.451390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-742b60eb-3237-4338-8790-46cca51467f6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:55.452671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-742b60eb-3237-4338-8790-46cca51467f6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:55.460597 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-742b60eb-3237-4338-8790-46cca51467f6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:55.461495 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-742b60eb-3237-4338-8790-46cca51467f6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:55.462623 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-742b60eb-3237-4338-8790-46cca51467f6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:55.463616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-742b60eb-3237-4338-8790-46cca51467f6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:55.500646 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2723c59a-af18-46be-99b5-163630b6a5a2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:55.510048 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-2723c59a-af18-46be-99b5-163630b6a5a2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.187302 Aug 02 08:54:55.512106 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 102/189] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:55 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:55.623297 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-742b60eb-3237-4338-8790-46cca51467f6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:55.632033 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-742b60eb-3237-4338-8790-46cca51467f6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1553 microversion: 2.1 time: 0.188380 Aug 02 08:54:55.633133 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 88/190] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:55 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:56.532384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-519060b0-2421-4134-b68a-e6474a47fa92 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:56.533197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-519060b0-2421-4134-b68a-e6474a47fa92 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:56.539770 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-519060b0-2421-4134-b68a-e6474a47fa92 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:56.540350 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-519060b0-2421-4134-b68a-e6474a47fa92 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:56.541194 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-519060b0-2421-4134-b68a-e6474a47fa92 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:56.541678 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-519060b0-2421-4134-b68a-e6474a47fa92 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:56.653612 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a3eb0b98-906c-4782-8bab-ee84902424ec tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:56.654223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a3eb0b98-906c-4782-8bab-ee84902424ec tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:56.660848 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a3eb0b98-906c-4782-8bab-ee84902424ec tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:56.661307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a3eb0b98-906c-4782-8bab-ee84902424ec tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:56.662518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a3eb0b98-906c-4782-8bab-ee84902424ec tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:56.662954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a3eb0b98-906c-4782-8bab-ee84902424ec tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:56.708383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-519060b0-2421-4134-b68a-e6474a47fa92 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:56.716804 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-519060b0-2421-4134-b68a-e6474a47fa92 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.188453 Aug 02 08:54:56.717559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 103/191] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:56 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:56.845673 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a3eb0b98-906c-4782-8bab-ee84902424ec tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:56.855676 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a3eb0b98-906c-4782-8bab-ee84902424ec tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1553 microversion: 2.1 time: 0.206630 Aug 02 08:54:56.856596 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 89/192] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:56 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:54:57.742138 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a56f1579-d838-4106-ba01-a4c21661d7cf tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:57.743484 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a56f1579-d838-4106-ba01-a4c21661d7cf tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:57.750173 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a56f1579-d838-4106-ba01-a4c21661d7cf tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:57.750622 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a56f1579-d838-4106-ba01-a4c21661d7cf tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:57.751750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a56f1579-d838-4106-ba01-a4c21661d7cf tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:57.752374 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a56f1579-d838-4106-ba01-a4c21661d7cf tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:57.877254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d6eae1c2-484c-4ba9-ae91-a4c28b2d217b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:57.880866 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d6eae1c2-484c-4ba9-ae91-a4c28b2d217b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:57.888211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d6eae1c2-484c-4ba9-ae91-a4c28b2d217b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:57.888676 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d6eae1c2-484c-4ba9-ae91-a4c28b2d217b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:57.889461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d6eae1c2-484c-4ba9-ae91-a4c28b2d217b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:57.891298 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d6eae1c2-484c-4ba9-ae91-a4c28b2d217b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:57.898625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a56f1579-d838-4106-ba01-a4c21661d7cf tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:57.907786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a56f1579-d838-4106-ba01-a4c21661d7cf tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.169793 Aug 02 08:54:57.921503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 104/193] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:57 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:58.042912 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d6eae1c2-484c-4ba9-ae91-a4c28b2d217b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:58.052144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d6eae1c2-484c-4ba9-ae91-a4c28b2d217b tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1553 microversion: 2.1 time: 0.178868 Aug 02 08:54:58.052701 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 90/194] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:57 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:58.930133 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5cc33591-fe87-4aa9-a563-880a5dfeadcd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:58.930750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5cc33591-fe87-4aa9-a563-880a5dfeadcd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:58.940978 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5cc33591-fe87-4aa9-a563-880a5dfeadcd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:58.943202 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5cc33591-fe87-4aa9-a563-880a5dfeadcd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:58.945237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5cc33591-fe87-4aa9-a563-880a5dfeadcd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:58.945879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5cc33591-fe87-4aa9-a563-880a5dfeadcd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:59.076259 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0e2af100-867a-4b8c-91dc-4b2a43a33d96 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:54:59.077249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0e2af100-867a-4b8c-91dc-4b2a43a33d96 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:54:59.086875 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e2af100-867a-4b8c-91dc-4b2a43a33d96 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:59.090495 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e2af100-867a-4b8c-91dc-4b2a43a33d96 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:59.091309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e2af100-867a-4b8c-91dc-4b2a43a33d96 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:54:59.091756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e2af100-867a-4b8c-91dc-4b2a43a33d96 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:54:59.094339 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5cc33591-fe87-4aa9-a563-880a5dfeadcd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:59.102848 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5cc33591-fe87-4aa9-a563-880a5dfeadcd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.176561 Aug 02 08:54:59.103900 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 105/195] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:58 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:54:59.327224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0e2af100-867a-4b8c-91dc-4b2a43a33d96 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:54:59.338548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0e2af100-867a-4b8c-91dc-4b2a43a33d96 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1553 microversion: 2.1 time: 0.266655 Aug 02 08:54:59.339245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 91/196] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:54:59 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:00.124338 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2d902363-2607-4d93-b5f4-61da61c35ef6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:00.124944 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-2d902363-2607-4d93-b5f4-61da61c35ef6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:00.132134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2d902363-2607-4d93-b5f4-61da61c35ef6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:00.132787 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2d902363-2607-4d93-b5f4-61da61c35ef6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:00.133565 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2d902363-2607-4d93-b5f4-61da61c35ef6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:00.134155 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2d902363-2607-4d93-b5f4-61da61c35ef6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:00.281753 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2d902363-2607-4d93-b5f4-61da61c35ef6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:00.289501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-2d902363-2607-4d93-b5f4-61da61c35ef6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.168848 Aug 02 08:55:00.296864 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 106/197] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:00 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:00.362880 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1c4a34d3-eadd-4d05-95f5-d52f72d736ef tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:00.363644 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1c4a34d3-eadd-4d05-95f5-d52f72d736ef tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:00.370967 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1c4a34d3-eadd-4d05-95f5-d52f72d736ef tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:00.371486 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1c4a34d3-eadd-4d05-95f5-d52f72d736ef tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:00.372297 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1c4a34d3-eadd-4d05-95f5-d52f72d736ef tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:00.372738 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1c4a34d3-eadd-4d05-95f5-d52f72d736ef tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:00.510769 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1c4a34d3-eadd-4d05-95f5-d52f72d736ef tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:00.520679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1c4a34d3-eadd-4d05-95f5-d52f72d736ef tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1553 microversion: 2.1 time: 0.161994 Aug 02 08:55:00.521414 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 92/198] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:00 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:01.310849 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f0fadc2e-039d-4aa8-861b-63c223be2274 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:01.311491 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f0fadc2e-039d-4aa8-861b-63c223be2274 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:01.318354 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0fadc2e-039d-4aa8-861b-63c223be2274 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:01.318844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0fadc2e-039d-4aa8-861b-63c223be2274 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:01.319677 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0fadc2e-039d-4aa8-861b-63c223be2274 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:01.320109 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0fadc2e-039d-4aa8-861b-63c223be2274 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:01.453321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f0fadc2e-039d-4aa8-861b-63c223be2274 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:01.461179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f0fadc2e-039d-4aa8-861b-63c223be2274 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.154242 Aug 02 08:55:01.461745 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 107/199] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:01 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:01.542669 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d2a6ca35-491c-4fbd-9497-94fd64b94808 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:01.543276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d2a6ca35-491c-4fbd-9497-94fd64b94808 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:01.549217 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d2a6ca35-491c-4fbd-9497-94fd64b94808 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:01.549661 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d2a6ca35-491c-4fbd-9497-94fd64b94808 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:01.550422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d2a6ca35-491c-4fbd-9497-94fd64b94808 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:01.550857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d2a6ca35-491c-4fbd-9497-94fd64b94808 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:01.679041 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d2a6ca35-491c-4fbd-9497-94fd64b94808 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:01.687712 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d2a6ca35-491c-4fbd-9497-94fd64b94808 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1553 microversion: 2.1 time: 0.148953 Aug 02 08:55:01.688310 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 93/200] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:01 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:02.448634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-f1dbafc3-ffd3-4639-acff-c1fa1c7de83b req-d0e5fb0f-f15a-4bdb-9ad4-240f36e02914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bfc599-c1b3-4328-88b1-c8e505562480", "name": "network-vif-unplugged", "status": "completed", "tag": "4265e426-406d-4e2d-b009-de8ff72ede37"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:02.460676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-f1dbafc3-ffd3-4639-acff-c1fa1c7de83b req-d0e5fb0f-f15a-4bdb-9ad4-240f36e02914 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:02.461140 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-f1dbafc3-ffd3-4639-acff-c1fa1c7de83b req-d0e5fb0f-f15a-4bdb-9ad4-240f36e02914 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:02.472384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-f1dbafc3-ffd3-4639-acff-c1fa1c7de83b req-d0e5fb0f-f15a-4bdb-9ad4-240f36e02914 service nova] Creating event network-vif-unplugged:4265e426-406d-4e2d-b009-de8ff72ede37 for instance e0bfc599-c1b3-4328-88b1-c8e505562480 on hv-cinder-78729 Aug 02 08:55:02.477326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-f1dbafc3-ffd3-4639-acff-c1fa1c7de83b req-d0e5fb0f-f15a-4bdb-9ad4-240f36e02914 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032438 Aug 02 08:55:02.482895 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ec6e1012-f645-4020-bb03-c1a7a8b0554a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:02.483648 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ec6e1012-f645-4020-bb03-c1a7a8b0554a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:02.487023 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 108/201] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:02.490157 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ec6e1012-f645-4020-bb03-c1a7a8b0554a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:02.490679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ec6e1012-f645-4020-bb03-c1a7a8b0554a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:02.491355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ec6e1012-f645-4020-bb03-c1a7a8b0554a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:02.491785 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ec6e1012-f645-4020-bb03-c1a7a8b0554a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:02.629367 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ec6e1012-f645-4020-bb03-c1a7a8b0554a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:02.637104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ec6e1012-f645-4020-bb03-c1a7a8b0554a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.158155 Aug 02 08:55:02.637681 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 94/202] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:02 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:02.710178 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-478f305f-ff92-4aea-8158-82fd2629f920 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:02.710875 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-478f305f-ff92-4aea-8158-82fd2629f920 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:02.717513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-478f305f-ff92-4aea-8158-82fd2629f920 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:02.718175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-478f305f-ff92-4aea-8158-82fd2629f920 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:02.719048 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-478f305f-ff92-4aea-8158-82fd2629f920 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:02.719558 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-478f305f-ff92-4aea-8158-82fd2629f920 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:02.913057 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-478f305f-ff92-4aea-8158-82fd2629f920 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:02.921669 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-478f305f-ff92-4aea-8158-82fd2629f920 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1553 microversion: 2.1 time: 0.215547 Aug 02 08:55:02.922281 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 109/203] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:02 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:03.049496 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-9bec4507-8453-4e09-8d1c-1db12b94b096 req-dd256510-ca91-47af-bd8b-0e1fbe0a6516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bfc599-c1b3-4328-88b1-c8e505562480", "name": "network-vif-deleted", "tag": "4265e426-406d-4e2d-b009-de8ff72ede37"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:03.062311 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-9bec4507-8453-4e09-8d1c-1db12b94b096 req-dd256510-ca91-47af-bd8b-0e1fbe0a6516 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:03.062758 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-9bec4507-8453-4e09-8d1c-1db12b94b096 req-dd256510-ca91-47af-bd8b-0e1fbe0a6516 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:03.075909 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-9bec4507-8453-4e09-8d1c-1db12b94b096 req-dd256510-ca91-47af-bd8b-0e1fbe0a6516 service nova] Creating event network-vif-deleted:4265e426-406d-4e2d-b009-de8ff72ede37 for instance e0bfc599-c1b3-4328-88b1-c8e505562480 on hv-cinder-78729 Aug 02 08:55:03.081784 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-9bec4507-8453-4e09-8d1c-1db12b94b096 req-dd256510-ca91-47af-bd8b-0e1fbe0a6516 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036269 Aug 02 08:55:03.082508 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 95/204] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:03.658150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5efde6c3-c04f-447a-88c5-47772a0de032 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:03.658760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5efde6c3-c04f-447a-88c5-47772a0de032 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:03.665291 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5efde6c3-c04f-447a-88c5-47772a0de032 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:03.665738 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5efde6c3-c04f-447a-88c5-47772a0de032 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:03.666497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5efde6c3-c04f-447a-88c5-47772a0de032 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:03.666932 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5efde6c3-c04f-447a-88c5-47772a0de032 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:03.796477 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5efde6c3-c04f-447a-88c5-47772a0de032 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:03.804943 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5efde6c3-c04f-447a-88c5-47772a0de032 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.151304 Aug 02 08:55:03.805518 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 110/205] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:03 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:03.944027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c2819edb-e59c-488e-b100-4afb86c50aac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:03.944970 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c2819edb-e59c-488e-b100-4afb86c50aac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:03.953704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c2819edb-e59c-488e-b100-4afb86c50aac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:03.954499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c2819edb-e59c-488e-b100-4afb86c50aac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:03.956268 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c2819edb-e59c-488e-b100-4afb86c50aac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:03.956367 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c2819edb-e59c-488e-b100-4afb86c50aac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:04.023414 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c2819edb-e59c-488e-b100-4afb86c50aac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83b16baa6944aa299cd112043306f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e350e1aaf5d446b989d2e6c7ab90e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:04.033209 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c2819edb-e59c-488e-b100-4afb86c50aac tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 200 len: 1345 microversion: 2.1 time: 0.093701 Aug 02 08:55:04.034738 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 96/206] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:03 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:04.829845 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-eb548783-f028-4bca-a2ba-19f43e468f50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:04.831187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-eb548783-f028-4bca-a2ba-19f43e468f50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:04.839033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb548783-f028-4bca-a2ba-19f43e468f50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:04.839863 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb548783-f028-4bca-a2ba-19f43e468f50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:04.841732 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb548783-f028-4bca-a2ba-19f43e468f50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:04.842608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb548783-f028-4bca-a2ba-19f43e468f50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:05.007113 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-eb548783-f028-4bca-a2ba-19f43e468f50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:05.015859 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-eb548783-f028-4bca-a2ba-19f43e468f50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.191476 Aug 02 08:55:05.016492 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 111/207] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:04 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:05.054631 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:05.055248 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:05.061618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:05.062062 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:05.062827 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:05.063264 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:05.076332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] HTTP exception thrown: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Request method failure captured: Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 HTTP/1.1 Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYcwMJ6v-N_i4ERQn6aBIPRcXn7rwAJHV8qPDvlW8SLguU5ZDjOOpZvMtVEnitkGbJZkorMMiA5yRhqGFaLeOYBXWWFb_2_gLAECFO4LVfn3XM7Jkz5OlAFvV2DUluK7Hdf1E0lLWXZkx_uXP-JbxlY-K02hSVo1NZ0vOVa-DPAS2s Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: e350e1aaf5d446b989d2e6c7ab90e133 Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 08:55:05.087223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e350e1aaf5d446b989d2e6c7ab90e133", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e350e1aaf5d446b989d2e6c7ab90e133"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e350e1aaf5d446b989d2e6c7ab90e133"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e350e1aaf5d446b989d2e6c7ab90e133"}]}] Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: e350e1aaf5d446b989d2e6c7ab90e133 Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-DeleteServersTestJSON-1589089315-project Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e83b16baa6944aa299cd112043306f68 Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-DeleteServersTestJSON-1589089315-project Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.088795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'e0bfc599-c1b3-4328-88b1-c8e505562480'} Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:55:05.089581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.090936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.092515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Returning 404 to user: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:55:05.092515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6b5fbdaa-7ec0-4b37-896f-b8042149ed26 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 404 len: 111 microversion: 2.1 time: 0.037876 Aug 02 08:55:05.092515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 97/208] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:05 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:55:05.197470 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:05.199650 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:05.206067 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:05.206513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:05.207269 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:05.207966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:05.222371 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] HTTP exception thrown: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Request method failure captured: Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480/os-volume_attachments HTTP/1.1 Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYcwMJ6v-N_i4ERQn6aBIPRcXn7rwAJHV8qPDvlW8SLguU5ZDjOOpZvMtVEnitkGbJZkorMMiA5yRhqGFaLeOYBXWWFb_2_gLAECFO4LVfn3XM7Jkz5OlAFvV2DUluK7Hdf1E0lLWXZkx_uXP-JbxlY-K02hSVo1NZ0vOVa-DPAS2s Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: e350e1aaf5d446b989d2e6c7ab90e133 Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:55:05.226383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e350e1aaf5d446b989d2e6c7ab90e133", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e350e1aaf5d446b989d2e6c7ab90e133"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e350e1aaf5d446b989d2e6c7ab90e133"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e350e1aaf5d446b989d2e6c7ab90e133"}]}] Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: e350e1aaf5d446b989d2e6c7ab90e133 Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-DeleteServersTestJSON-1589089315-project Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: e83b16baa6944aa299cd112043306f68 Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-DeleteServersTestJSON-1589089315-project Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.227785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'server_id': 'e0bfc599-c1b3-4328-88b1-c8e505562480'} Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:55:05.228620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:05.229924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:05.231246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Returning 404 to user: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:55:05.231246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ed837672-1abf-40fb-ab9e-e9e1a3e0a52e tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034281 Aug 02 08:55:05.231246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 112/209] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 08:55:05 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:55:06.037535 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3662211a-9bce-4c09-a052-8a17b386756c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:06.038636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3662211a-9bce-4c09-a052-8a17b386756c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:06.044240 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3662211a-9bce-4c09-a052-8a17b386756c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:06.044691 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3662211a-9bce-4c09-a052-8a17b386756c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:06.045465 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3662211a-9bce-4c09-a052-8a17b386756c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:06.046395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3662211a-9bce-4c09-a052-8a17b386756c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:06.179880 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3662211a-9bce-4c09-a052-8a17b386756c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:06.187324 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3662211a-9bce-4c09-a052-8a17b386756c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.153678 Aug 02 08:55:06.187886 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 98/210] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:06 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:07.209968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-68f6c177-57f1-45ae-8d58-65a468c2ddd8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:07.210679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-68f6c177-57f1-45ae-8d58-65a468c2ddd8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:07.217162 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-68f6c177-57f1-45ae-8d58-65a468c2ddd8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:07.217861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-68f6c177-57f1-45ae-8d58-65a468c2ddd8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:07.219115 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-68f6c177-57f1-45ae-8d58-65a468c2ddd8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:07.219547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-68f6c177-57f1-45ae-8d58-65a468c2ddd8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:07.465670 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-68f6c177-57f1-45ae-8d58-65a468c2ddd8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:07.481162 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-68f6c177-57f1-45ae-8d58-65a468c2ddd8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.276028 Aug 02 08:55:07.481740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 113/211] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:07 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:07.484746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:07.485227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:07.487265 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:07.502231 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:07.502714 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:07.503745 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:07.504299 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:07.519439 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] HTTP exception thrown: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Request method failure captured: Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 HTTP/1.1 Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYcwMJ6v-N_i4ERQn6aBIPRcXn7rwAJHV8qPDvlW8SLguU5ZDjOOpZvMtVEnitkGbJZkorMMiA5yRhqGFaLeOYBXWWFb_2_gLAECFO4LVfn3XM7Jkz5OlAFvV2DUluK7Hdf1E0lLWXZkx_uXP-JbxlY-K02hSVo1NZ0vOVa-DPAS2s Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: e350e1aaf5d446b989d2e6c7ab90e133 Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 08:55:07.520366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e350e1aaf5d446b989d2e6c7ab90e133", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e350e1aaf5d446b989d2e6c7ab90e133"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e350e1aaf5d446b989d2e6c7ab90e133"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e350e1aaf5d446b989d2e6c7ab90e133"}]}] Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: e350e1aaf5d446b989d2e6c7ab90e133 Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-DeleteServersTestJSON-1589089315-project Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e83b16baa6944aa299cd112043306f68 Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-DeleteServersTestJSON-1589089315-project Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.521581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'e0bfc599-c1b3-4328-88b1-c8e505562480'} Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:55:07.524534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.525829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.527116 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Returning 404 to user: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:55:07.527116 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-40b043ae-878c-4cb7-a653-e0d3863fc6de tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 404 len: 111 microversion: 2.1 time: 0.041628 Aug 02 08:55:07.527116 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 99/212] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 08:55:07 2022] DELETE /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:55:07.532230 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:07.533059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] [instance: e0bfc599-c1b3-4328-88b1-c8e505562480] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:07.540696 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:07.540813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:07.541758 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:07.542278 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:07.559725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] HTTP exception thrown: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Request method failure captured: Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 HTTP/1.1 Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYcwMJ6v-N_i4ERQn6aBIPRcXn7rwAJHV8qPDvlW8SLguU5ZDjOOpZvMtVEnitkGbJZkorMMiA5yRhqGFaLeOYBXWWFb_2_gLAECFO4LVfn3XM7Jkz5OlAFvV2DUluK7Hdf1E0lLWXZkx_uXP-JbxlY-K02hSVo1NZ0vOVa-DPAS2s Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: e350e1aaf5d446b989d2e6c7ab90e133 Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:55:07.563373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e350e1aaf5d446b989d2e6c7ab90e133", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e350e1aaf5d446b989d2e6c7ab90e133"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e350e1aaf5d446b989d2e6c7ab90e133"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e350e1aaf5d446b989d2e6c7ab90e133"}]}] Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: e350e1aaf5d446b989d2e6c7ab90e133 Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-DeleteServersTestJSON-1589089315 Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-DeleteServersTestJSON-1589089315-project Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: e83b16baa6944aa299cd112043306f68 Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-DeleteServersTestJSON-1589089315-project Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.564921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'e0bfc599-c1b3-4328-88b1-c8e505562480'} Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:55:07.565725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. Aug 02 08:55:07.566854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:55:07.569728 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] Returning 404 to user: Instance e0bfc599-c1b3-4328-88b1-c8e505562480 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:55:07.570826 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c6d63da8-82e8-4761-9bfe-73d09b3d90b6 tempest-DeleteServersTestJSON-1589089315 tempest-DeleteServersTestJSON-1589089315-project] 10.222.0.17 "GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480" status: 404 len: 111 microversion: 2.1 time: 0.042919 Aug 02 08:55:07.571433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 114/213] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:07 2022] GET /compute/v2.1/servers/e0bfc599-c1b3-4328-88b1-c8e505562480 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:55:08.502849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-05807481-243d-44ab-a958-725ebb6fdaea tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:08.504111 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-05807481-243d-44ab-a958-725ebb6fdaea tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:08.510737 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-05807481-243d-44ab-a958-725ebb6fdaea tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:08.511522 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-05807481-243d-44ab-a958-725ebb6fdaea tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:08.512561 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-05807481-243d-44ab-a958-725ebb6fdaea tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:08.513196 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-05807481-243d-44ab-a958-725ebb6fdaea tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:08.758076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-05807481-243d-44ab-a958-725ebb6fdaea tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:08.772868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-05807481-243d-44ab-a958-725ebb6fdaea tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.271657 Aug 02 08:55:08.774272 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 100/214] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:08 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:09.797437 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-aa394ad2-b85c-4a7d-9f9c-e0b763ed1fb6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:09.798044 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-aa394ad2-b85c-4a7d-9f9c-e0b763ed1fb6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:09.821977 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa394ad2-b85c-4a7d-9f9c-e0b763ed1fb6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:09.822672 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa394ad2-b85c-4a7d-9f9c-e0b763ed1fb6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:09.823803 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa394ad2-b85c-4a7d-9f9c-e0b763ed1fb6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:09.824443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa394ad2-b85c-4a7d-9f9c-e0b763ed1fb6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:10.108008 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-aa394ad2-b85c-4a7d-9f9c-e0b763ed1fb6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:10.131482 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-aa394ad2-b85c-4a7d-9f9c-e0b763ed1fb6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1521 microversion: 2.1 time: 0.339717 Aug 02 08:55:10.132655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 115/215] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:09 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:11.158265 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c214f9a5-46af-4683-8544-99fc9ee170e1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:11.158976 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c214f9a5-46af-4683-8544-99fc9ee170e1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:11.165382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c214f9a5-46af-4683-8544-99fc9ee170e1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:11.167665 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c214f9a5-46af-4683-8544-99fc9ee170e1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:11.168734 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c214f9a5-46af-4683-8544-99fc9ee170e1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:11.176701 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c214f9a5-46af-4683-8544-99fc9ee170e1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:11.442003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c214f9a5-46af-4683-8544-99fc9ee170e1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:11.459358 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c214f9a5-46af-4683-8544-99fc9ee170e1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1501 microversion: 2.1 time: 0.305423 Aug 02 08:55:11.475786 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 101/216] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:11 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1501 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:11.479472 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d0b7325d-0c9c-44d1-b830-002b623d08f5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:11.480104 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d0b7325d-0c9c-44d1-b830-002b623d08f5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:11.489854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d0b7325d-0c9c-44d1-b830-002b623d08f5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:11.490704 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d0b7325d-0c9c-44d1-b830-002b623d08f5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:11.499806 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d0b7325d-0c9c-44d1-b830-002b623d08f5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:11.501618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d0b7325d-0c9c-44d1-b830-002b623d08f5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:11.761688 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d0b7325d-0c9c-44d1-b830-002b623d08f5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:11.773549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d0b7325d-0c9c-44d1-b830-002b623d08f5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1516 microversion: 2.1 time: 0.297912 Aug 02 08:55:11.774065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 116/217] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:11 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1516 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:12.552690 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-397645669", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "networks": [{"uuid": "eef0ab1f-9f99-4dbf-a7d7-6a0a7959e7e2"}]}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:12.610157 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] validate_networks() for [('eef0ab1f-9f99-4dbf-a7d7-6a0a7959e7e2', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:55:13.016389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:55:13.017016 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:55:13.017724 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:55:13.018137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:55:13.018896 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:55:13.031804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:13.032414 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:13.033811 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:13.034453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:13.060446 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Getting quotas for project b40df4325f5c495396daab8f57b0dcf4. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:55:13.065897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Getting quotas for user 41650f44d6a14a1abab40d3f05317fa8 and project b40df4325f5c495396daab8f57b0dcf4. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:55:13.084927 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:55:13.087769 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:55:13.174016 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4bcd5d61-e10c-4497-93ad-597e6fac3311 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625424 Aug 02 08:55:13.174670 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 102/218] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:55:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 08:55:13.185938 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-29f6c796-4797-4c95-a5c6-98ad3beb2fc8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:13.186746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-29f6c796-4797-4c95-a5c6-98ad3beb2fc8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:13.192581 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=42 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:13.271168 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-29f6c796-4797-4c95-a5c6-98ad3beb2fc8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:13.278974 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-29f6c796-4797-4c95-a5c6-98ad3beb2fc8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1218 microversion: 2.1 time: 0.097421 Aug 02 08:55:13.279893 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 117/219] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:13 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:14.302634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-bd1d4f66-e008-43f5-a68d-bff529188fac tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:14.303259 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-bd1d4f66-e008-43f5-a68d-bff529188fac tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:14.312029 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bd1d4f66-e008-43f5-a68d-bff529188fac tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:14.312482 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bd1d4f66-e008-43f5-a68d-bff529188fac tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:14.313305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bd1d4f66-e008-43f5-a68d-bff529188fac tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:14.313773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bd1d4f66-e008-43f5-a68d-bff529188fac tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:14.385059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-bd1d4f66-e008-43f5-a68d-bff529188fac tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:14.394680 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-bd1d4f66-e008-43f5-a68d-bff529188fac tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1222 microversion: 2.1 time: 0.097066 Aug 02 08:55:14.395442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 103/220] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:14 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:15.416556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0349198b-ea29-4449-b802-21e1b65d38af tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:15.417143 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0349198b-ea29-4449-b802-21e1b65d38af tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:15.424712 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0349198b-ea29-4449-b802-21e1b65d38af tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:15.425157 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0349198b-ea29-4449-b802-21e1b65d38af tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:15.426102 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0349198b-ea29-4449-b802-21e1b65d38af tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:15.426836 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0349198b-ea29-4449-b802-21e1b65d38af tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:15.445647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=100 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:15.532744 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0349198b-ea29-4449-b802-21e1b65d38af tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:15.540705 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0349198b-ea29-4449-b802-21e1b65d38af tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1222 microversion: 2.1 time: 0.128095 Aug 02 08:55:15.541471 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 118/221] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:15 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:16.562478 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5958b522-a28c-4f66-9437-52cd60ae1464 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:16.564326 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5958b522-a28c-4f66-9437-52cd60ae1464 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:16.571286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5958b522-a28c-4f66-9437-52cd60ae1464 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:16.572073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5958b522-a28c-4f66-9437-52cd60ae1464 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:16.573274 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5958b522-a28c-4f66-9437-52cd60ae1464 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:16.573920 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5958b522-a28c-4f66-9437-52cd60ae1464 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:16.656766 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5958b522-a28c-4f66-9437-52cd60ae1464 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:16.664977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5958b522-a28c-4f66-9437-52cd60ae1464 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1222 microversion: 2.1 time: 0.107122 Aug 02 08:55:16.665745 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 104/222] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:16 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:17.686000 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e0c21eab-1939-4717-a3d4-3b98c53cb53f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:17.687036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e0c21eab-1939-4717-a3d4-3b98c53cb53f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:17.693649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e0c21eab-1939-4717-a3d4-3b98c53cb53f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:17.694096 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e0c21eab-1939-4717-a3d4-3b98c53cb53f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:17.694871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e0c21eab-1939-4717-a3d4-3b98c53cb53f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:17.695312 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e0c21eab-1939-4717-a3d4-3b98c53cb53f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:17.788998 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e0c21eab-1939-4717-a3d4-3b98c53cb53f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:17.800551 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e0c21eab-1939-4717-a3d4-3b98c53cb53f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1222 microversion: 2.1 time: 0.118362 Aug 02 08:55:17.801571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 119/223] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:17 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:18.250161 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-cc811410-f1ff-4738-a61b-011e3743a5ea tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: .version_select at 0x7f13fac29d30>, body: {"keypair": {"name": "tempest-keypair-1678686346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0V0XBq7TN+6HBMy91H1HMYR4jV5B53s47lxhaVP/JDtEp/4z4p8TzL4GO4uVx9PXzHC3dFvjkBBkPQrOAxFaZRC2yRawtshGprhbCgS/bp1b/+m6tletwsYD5M2AzGtQ=="}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:18.266421 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-cc811410-f1ff-4738-a61b-011e3743a5ea tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for project 3179955b76864553a96682674d01b781. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:55:18.270350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-cc811410-f1ff-4738-a61b-011e3743a5ea tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for user f01062e92f974dc890897d19359e7e63 and project 3179955b76864553a96682674d01b781. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:55:18.294422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-cc811410-f1ff-4738-a61b-011e3743a5ea tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164237 Aug 02 08:55:18.295045 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 105/224] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 08:55:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:18.822340 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e625c598-f60c-43dd-98dc-15d21f1f973f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:18.825782 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e625c598-f60c-43dd-98dc-15d21f1f973f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:18.835135 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e625c598-f60c-43dd-98dc-15d21f1f973f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:18.835806 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e625c598-f60c-43dd-98dc-15d21f1f973f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:18.838139 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e625c598-f60c-43dd-98dc-15d21f1f973f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:18.838846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e625c598-f60c-43dd-98dc-15d21f1f973f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:18.914502 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e625c598-f60c-43dd-98dc-15d21f1f973f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:18.922055 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e625c598-f60c-43dd-98dc-15d21f1f973f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1270 microversion: 2.1 time: 0.104045 Aug 02 08:55:18.922641 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 120/225] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:18 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:19.748598 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1538639561", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99261d5d-9777-4359-9363-b7001791ac96"}], "security_groups": [{"name": "tempest-securitygroup--495137654"}], "key_name": "tempest-keypair-1678686346", "user_data": "}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:19.867389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] validate_networks() for [('99261d5d-9777-4359-9363-b7001791ac96', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:55:19.946274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c8c06b48-2806-456b-95dc-9e1583a574cb tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:19.946874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c8c06b48-2806-456b-95dc-9e1583a574cb tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:19.954053 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8c06b48-2806-456b-95dc-9e1583a574cb tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:19.954496 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8c06b48-2806-456b-95dc-9e1583a574cb tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:19.955262 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8c06b48-2806-456b-95dc-9e1583a574cb tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:19.955863 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8c06b48-2806-456b-95dc-9e1583a574cb tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:20.034873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c8c06b48-2806-456b-95dc-9e1583a574cb tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:20.052501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c8c06b48-2806-456b-95dc-9e1583a574cb tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1276 microversion: 2.1 time: 0.108255 Aug 02 08:55:20.054264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 121/226] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:19 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:20.626305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:55:20.626747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:55:20.627382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:55:20.628045 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:55:20.629021 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:55:20.641373 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:20.642036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:20.652872 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:20.655249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:20.684733 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for project 3179955b76864553a96682674d01b781. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:55:20.693084 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for user f01062e92f974dc890897d19359e7e63 and project 3179955b76864553a96682674d01b781. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:55:20.755013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:55:20.757190 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:55:20.786294 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-03d066a9-a4fa-47a3-a945-b131094875fb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:20.789740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-03d066a9-a4fa-47a3-a945-b131094875fb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:20.801834 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-03d066a9-a4fa-47a3-a945-b131094875fb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:20.802650 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-03d066a9-a4fa-47a3-a945-b131094875fb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:20.803781 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-03d066a9-a4fa-47a3-a945-b131094875fb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:20.804947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-03d066a9-a4fa-47a3-a945-b131094875fb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:20.840842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-03d066a9-a4fa-47a3-a945-b131094875fb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lazy-loading 'flavor' on Instance uuid 64a7f63d-5a88-4149-ba8c-843268dae669 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:55:20.855115 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8d17024e-db31-4906-a7c7-272c1a6f473e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.110066 Aug 02 08:55:20.858811 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 106/227] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:55:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:55:20.873350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-653ae7e2-488d-48d0-8bd8-c3585744a290 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:20.881174 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-653ae7e2-488d-48d0-8bd8-c3585744a290 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:20.975960 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-653ae7e2-488d-48d0-8bd8-c3585744a290 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:20.984933 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-653ae7e2-488d-48d0-8bd8-c3585744a290 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1242 microversion: 2.1 time: 0.119621 Aug 02 08:55:20.985507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 107/228] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:20 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:21.058673 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-03d066a9-a4fa-47a3-a945-b131094875fb tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669/action" status: 200 len: 32 microversion: 2.1 time: 0.279300 Aug 02 08:55:21.059934 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 122/229] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 08:55:20 2022] POST /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 08:55:21.069773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c472ecde-6de9-4114-ae1b-001b7d160cf1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:21.071735 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c472ecde-6de9-4114-ae1b-001b7d160cf1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:21.078628 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-49bafa9d-010f-415d-97cf-1af0c99f5764 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:21.079451 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-49bafa9d-010f-415d-97cf-1af0c99f5764 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:21.095752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c472ecde-6de9-4114-ae1b-001b7d160cf1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:21.096267 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c472ecde-6de9-4114-ae1b-001b7d160cf1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:21.097051 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c472ecde-6de9-4114-ae1b-001b7d160cf1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:21.097487 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c472ecde-6de9-4114-ae1b-001b7d160cf1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:21.106764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-49bafa9d-010f-415d-97cf-1af0c99f5764 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:21.107222 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-49bafa9d-010f-415d-97cf-1af0c99f5764 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:21.108059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-49bafa9d-010f-415d-97cf-1af0c99f5764 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:21.112054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-49bafa9d-010f-415d-97cf-1af0c99f5764 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:21.497854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-49bafa9d-010f-415d-97cf-1af0c99f5764 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:21.515588 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-49bafa9d-010f-415d-97cf-1af0c99f5764 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.439304 Aug 02 08:55:21.516777 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 123/230] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:21 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:21.528704 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-6217ee0b-8ef7-4aee-a516-b2f2afa89c6d req-4685e65e-9d42-4a2c-a1ff-5e91d20139f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb4ab28-698c-4f0d-a1a6-932951362ac0", "tag": "a56ed13f-315a-489b-a828-95c0c7dc7794"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:21.548493 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-6217ee0b-8ef7-4aee-a516-b2f2afa89c6d req-4685e65e-9d42-4a2c-a1ff-5e91d20139f9 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:21.548946 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-6217ee0b-8ef7-4aee-a516-b2f2afa89c6d req-4685e65e-9d42-4a2c-a1ff-5e91d20139f9 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:21.585842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-6217ee0b-8ef7-4aee-a516-b2f2afa89c6d req-4685e65e-9d42-4a2c-a1ff-5e91d20139f9 service nova] Creating event network-changed:a56ed13f-315a-489b-a828-95c0c7dc7794 for instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 on hv-cinder-78729 Aug 02 08:55:21.595315 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-6217ee0b-8ef7-4aee-a516-b2f2afa89c6d req-4685e65e-9d42-4a2c-a1ff-5e91d20139f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076836 Aug 02 08:55:21.596307 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 124/231] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:21.642841 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c472ecde-6de9-4114-ae1b-001b7d160cf1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:21.654221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c472ecde-6de9-4114-ae1b-001b7d160cf1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.587652 Aug 02 08:55:21.655805 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 108/232] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:21 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:22.008387 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6bcff068-d628-4f54-bd2d-c3dd61d5ba99 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:22.009270 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6bcff068-d628-4f54-bd2d-c3dd61d5ba99 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:22.023835 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6bcff068-d628-4f54-bd2d-c3dd61d5ba99 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:22.028764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6bcff068-d628-4f54-bd2d-c3dd61d5ba99 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:22.029776 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6bcff068-d628-4f54-bd2d-c3dd61d5ba99 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:22.030361 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6bcff068-d628-4f54-bd2d-c3dd61d5ba99 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:22.111261 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6bcff068-d628-4f54-bd2d-c3dd61d5ba99 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:22.118425 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6bcff068-d628-4f54-bd2d-c3dd61d5ba99 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1294 microversion: 2.1 time: 0.115264 Aug 02 08:55:22.118997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 125/233] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:22 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:22.538103 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-33c47c8d-9bbe-43a4-bf49-4abf08cb536b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:22.538819 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-33c47c8d-9bbe-43a4-bf49-4abf08cb536b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:22.546023 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-33c47c8d-9bbe-43a4-bf49-4abf08cb536b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:22.546584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-33c47c8d-9bbe-43a4-bf49-4abf08cb536b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:22.547467 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-33c47c8d-9bbe-43a4-bf49-4abf08cb536b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:22.547964 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-33c47c8d-9bbe-43a4-bf49-4abf08cb536b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:22.567296 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:22.677376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f6b71bea-db17-4395-8200-5e93deb0eea5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:22.678020 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f6b71bea-db17-4395-8200-5e93deb0eea5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:22.683995 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f6b71bea-db17-4395-8200-5e93deb0eea5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:22.684481 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f6b71bea-db17-4395-8200-5e93deb0eea5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:22.685253 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f6b71bea-db17-4395-8200-5e93deb0eea5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:22.685693 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f6b71bea-db17-4395-8200-5e93deb0eea5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:22.685899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-33c47c8d-9bbe-43a4-bf49-4abf08cb536b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:22.693228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-33c47c8d-9bbe-43a4-bf49-4abf08cb536b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.158986 Aug 02 08:55:22.693803 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 109/234] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:22 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:22.814679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f6b71bea-db17-4395-8200-5e93deb0eea5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:22.822451 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f6b71bea-db17-4395-8200-5e93deb0eea5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.148936 Aug 02 08:55:22.823099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 126/235] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:22 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:23.140653 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9f12e296-664a-4799-bc3b-4a5ac203bca1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:23.141381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9f12e296-664a-4799-bc3b-4a5ac203bca1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:23.148778 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9f12e296-664a-4799-bc3b-4a5ac203bca1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:23.149298 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9f12e296-664a-4799-bc3b-4a5ac203bca1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:23.150511 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9f12e296-664a-4799-bc3b-4a5ac203bca1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:23.151511 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9f12e296-664a-4799-bc3b-4a5ac203bca1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:23.215248 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9f12e296-664a-4799-bc3b-4a5ac203bca1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:23.223381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9f12e296-664a-4799-bc3b-4a5ac203bca1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1302 microversion: 2.1 time: 0.087744 Aug 02 08:55:23.223952 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 110/236] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:23 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:23.715254 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cff11970-5756-4a0e-9071-5f98e7eb5b1b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:23.716103 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-cff11970-5756-4a0e-9071-5f98e7eb5b1b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:23.718343 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:23.725016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cff11970-5756-4a0e-9071-5f98e7eb5b1b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:23.725491 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cff11970-5756-4a0e-9071-5f98e7eb5b1b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:23.726261 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cff11970-5756-4a0e-9071-5f98e7eb5b1b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:23.726685 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cff11970-5756-4a0e-9071-5f98e7eb5b1b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:23.844053 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3beb2d07-aab4-4e2e-bd2f-21f0bbbb6469 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:23.844724 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3beb2d07-aab4-4e2e-bd2f-21f0bbbb6469 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:23.851541 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3beb2d07-aab4-4e2e-bd2f-21f0bbbb6469 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:23.851994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3beb2d07-aab4-4e2e-bd2f-21f0bbbb6469 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:23.852810 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3beb2d07-aab4-4e2e-bd2f-21f0bbbb6469 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:23.853287 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3beb2d07-aab4-4e2e-bd2f-21f0bbbb6469 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:24.001798 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3beb2d07-aab4-4e2e-bd2f-21f0bbbb6469 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:24.009248 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3beb2d07-aab4-4e2e-bd2f-21f0bbbb6469 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.169167 Aug 02 08:55:24.009820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 111/237] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:23 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:24.023947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-cff11970-5756-4a0e-9071-5f98e7eb5b1b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:24.031585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-cff11970-5756-4a0e-9071-5f98e7eb5b1b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.320547 Aug 02 08:55:24.032619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 127/238] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:23 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:24.247681 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ab672f2b-1922-4ff4-9c7c-ea51840361db tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:24.248498 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ab672f2b-1922-4ff4-9c7c-ea51840361db tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:24.255730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ab672f2b-1922-4ff4-9c7c-ea51840361db tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:24.256365 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ab672f2b-1922-4ff4-9c7c-ea51840361db tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:24.257379 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ab672f2b-1922-4ff4-9c7c-ea51840361db tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:24.258183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ab672f2b-1922-4ff4-9c7c-ea51840361db tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:24.329339 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ab672f2b-1922-4ff4-9c7c-ea51840361db tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:24.336933 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ab672f2b-1922-4ff4-9c7c-ea51840361db tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1302 microversion: 2.1 time: 0.095490 Aug 02 08:55:24.337491 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 112/239] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:24 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:25.037772 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-479418c8-86c9-4c4c-9ee0-6a711730d95f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:25.038384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-479418c8-86c9-4c4c-9ee0-6a711730d95f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:25.044949 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-479418c8-86c9-4c4c-9ee0-6a711730d95f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:25.045401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-479418c8-86c9-4c4c-9ee0-6a711730d95f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:25.046189 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-479418c8-86c9-4c4c-9ee0-6a711730d95f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:25.046721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-479418c8-86c9-4c4c-9ee0-6a711730d95f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:25.054437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5b50aab4-a4a2-4441-8cf8-9f288b3a3da8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:25.055085 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5b50aab4-a4a2-4441-8cf8-9f288b3a3da8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:25.062094 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5b50aab4-a4a2-4441-8cf8-9f288b3a3da8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:25.062477 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5b50aab4-a4a2-4441-8cf8-9f288b3a3da8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:25.063286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5b50aab4-a4a2-4441-8cf8-9f288b3a3da8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:25.063730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5b50aab4-a4a2-4441-8cf8-9f288b3a3da8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:25.182371 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-479418c8-86c9-4c4c-9ee0-6a711730d95f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:25.191099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-479418c8-86c9-4c4c-9ee0-6a711730d95f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.157159 Aug 02 08:55:25.192329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 128/240] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:25 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:25.209371 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5b50aab4-a4a2-4441-8cf8-9f288b3a3da8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:25.216844 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5b50aab4-a4a2-4441-8cf8-9f288b3a3da8 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.166221 Aug 02 08:55:25.217406 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 113/241] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:25 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:25.361453 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ab80fff0-609e-4330-ba43-fbadf54a57b4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:25.362073 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ab80fff0-609e-4330-ba43-fbadf54a57b4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:25.369869 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ab80fff0-609e-4330-ba43-fbadf54a57b4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:25.371958 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ab80fff0-609e-4330-ba43-fbadf54a57b4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:25.373150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ab80fff0-609e-4330-ba43-fbadf54a57b4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:25.373488 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ab80fff0-609e-4330-ba43-fbadf54a57b4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:25.445465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ab80fff0-609e-4330-ba43-fbadf54a57b4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:25.453988 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ab80fff0-609e-4330-ba43-fbadf54a57b4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1302 microversion: 2.1 time: 0.096888 Aug 02 08:55:25.465524 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 129/242] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:25 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:26.216455 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7e1874c1-cd29-40bc-85e5-e42513091374 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:26.217722 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7e1874c1-cd29-40bc-85e5-e42513091374 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:26.226366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7e1874c1-cd29-40bc-85e5-e42513091374 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:26.227097 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7e1874c1-cd29-40bc-85e5-e42513091374 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:26.228039 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7e1874c1-cd29-40bc-85e5-e42513091374 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:26.228660 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7e1874c1-cd29-40bc-85e5-e42513091374 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:26.239200 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e3c9ce8e-990c-4ea4-9570-c7e865bb7f47 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:26.240737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e3c9ce8e-990c-4ea4-9570-c7e865bb7f47 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:26.250295 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e3c9ce8e-990c-4ea4-9570-c7e865bb7f47 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:26.251022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e3c9ce8e-990c-4ea4-9570-c7e865bb7f47 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:26.251920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e3c9ce8e-990c-4ea4-9570-c7e865bb7f47 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:26.252453 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e3c9ce8e-990c-4ea4-9570-c7e865bb7f47 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:26.444882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7e1874c1-cd29-40bc-85e5-e42513091374 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:26.455725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7e1874c1-cd29-40bc-85e5-e42513091374 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.244907 Aug 02 08:55:26.471462 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 114/243] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:26 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:26.478031 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e3c9ce8e-990c-4ea4-9570-c7e865bb7f47 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:26.493989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-46c4917b-6bce-484a-8a4e-9cb5fdaf82b8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:26.494780 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-46c4917b-6bce-484a-8a4e-9cb5fdaf82b8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:26.508009 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e3c9ce8e-990c-4ea4-9570-c7e865bb7f47 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.253465 Aug 02 08:55:26.517702 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 130/244] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:26 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:26.524694 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-46c4917b-6bce-484a-8a4e-9cb5fdaf82b8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:26.525228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-46c4917b-6bce-484a-8a4e-9cb5fdaf82b8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:26.526093 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-46c4917b-6bce-484a-8a4e-9cb5fdaf82b8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:26.526538 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-46c4917b-6bce-484a-8a4e-9cb5fdaf82b8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:26.601336 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-46c4917b-6bce-484a-8a4e-9cb5fdaf82b8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:26.609016 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-46c4917b-6bce-484a-8a4e-9cb5fdaf82b8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1300 microversion: 2.1 time: 0.120786 Aug 02 08:55:26.609628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 115/245] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:26 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:27.088058 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-5e16596f-8163-44e9-a7cc-16ebe78e883d req-a34b18f1-e4ed-411f-96e6-9816d44f4ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb4ab28-698c-4f0d-a1a6-932951362ac0", "name": "network-vif-plugged", "status": "completed", "tag": "a56ed13f-315a-489b-a828-95c0c7dc7794"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:27.111049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-5e16596f-8163-44e9-a7cc-16ebe78e883d req-a34b18f1-e4ed-411f-96e6-9816d44f4ad1 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:27.111731 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-5e16596f-8163-44e9-a7cc-16ebe78e883d req-a34b18f1-e4ed-411f-96e6-9816d44f4ad1 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:27.123860 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-5e16596f-8163-44e9-a7cc-16ebe78e883d req-a34b18f1-e4ed-411f-96e6-9816d44f4ad1 service nova] Creating event network-vif-plugged:a56ed13f-315a-489b-a828-95c0c7dc7794 for instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 on hv-cinder-78729 Aug 02 08:55:27.133596 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-5e16596f-8163-44e9-a7cc-16ebe78e883d req-a34b18f1-e4ed-411f-96e6-9816d44f4ad1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049093 Aug 02 08:55:27.134361 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 131/246] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:55:27.378800 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-c371662d-7eb7-4e36-9674-24ec9be6891e req-c0b5f66a-34d4-4a4f-932c-66eff2428d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f712963-5f32-4332-b6e9-30269a5dccd1", "tag": "17befc5d-ad61-4c20-abc2-eb77700b5813"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:27.390844 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-c371662d-7eb7-4e36-9674-24ec9be6891e req-c0b5f66a-34d4-4a4f-932c-66eff2428d70 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:27.391396 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-c371662d-7eb7-4e36-9674-24ec9be6891e req-c0b5f66a-34d4-4a4f-932c-66eff2428d70 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:27.403888 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-c371662d-7eb7-4e36-9674-24ec9be6891e req-c0b5f66a-34d4-4a4f-932c-66eff2428d70 service nova] Creating event network-changed:17befc5d-ad61-4c20-abc2-eb77700b5813 for instance 8f712963-5f32-4332-b6e9-30269a5dccd1 on hv-cinder-78729 Aug 02 08:55:27.411451 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-c371662d-7eb7-4e36-9674-24ec9be6891e req-c0b5f66a-34d4-4a4f-932c-66eff2428d70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037608 Aug 02 08:55:27.412610 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 116/247] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:27.487670 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ff8c4d1b-8f7c-46af-a364-9be592fc4302 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:27.488427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ff8c4d1b-8f7c-46af-a364-9be592fc4302 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:27.496153 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ff8c4d1b-8f7c-46af-a364-9be592fc4302 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:27.497410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ff8c4d1b-8f7c-46af-a364-9be592fc4302 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:27.498874 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ff8c4d1b-8f7c-46af-a364-9be592fc4302 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:27.499319 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ff8c4d1b-8f7c-46af-a364-9be592fc4302 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:27.533085 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-af55ad37-dbca-4f86-a818-2ed172be8bb5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:27.533940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-af55ad37-dbca-4f86-a818-2ed172be8bb5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:27.540294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-af55ad37-dbca-4f86-a818-2ed172be8bb5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:27.540829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-af55ad37-dbca-4f86-a818-2ed172be8bb5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:27.541671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-af55ad37-dbca-4f86-a818-2ed172be8bb5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:27.542175 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-af55ad37-dbca-4f86-a818-2ed172be8bb5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:27.665807 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ff8c4d1b-8f7c-46af-a364-9be592fc4302 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:27.674522 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ff8c4d1b-8f7c-46af-a364-9be592fc4302 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.191724 Aug 02 08:55:27.675091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 132/248] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:27 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:27.679507 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f4fd9b70-3dc1-45e0-9d62-5e5ea3b9771b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:27.680107 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f4fd9b70-3dc1-45e0-9d62-5e5ea3b9771b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:27.684448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-af55ad37-dbca-4f86-a818-2ed172be8bb5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:27.686257 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f4fd9b70-3dc1-45e0-9d62-5e5ea3b9771b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:27.686705 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f4fd9b70-3dc1-45e0-9d62-5e5ea3b9771b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:27.687742 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f4fd9b70-3dc1-45e0-9d62-5e5ea3b9771b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:27.688205 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f4fd9b70-3dc1-45e0-9d62-5e5ea3b9771b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:27.692759 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-af55ad37-dbca-4f86-a818-2ed172be8bb5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.165853 Aug 02 08:55:27.695169 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 117/249] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:27 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:27.825346 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f4fd9b70-3dc1-45e0-9d62-5e5ea3b9771b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:27.833509 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f4fd9b70-3dc1-45e0-9d62-5e5ea3b9771b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.157461 Aug 02 08:55:27.834059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 133/250] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:27 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:28.694801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d98cd50c-351f-45f0-b966-6d5f1b9c780c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:28.695408 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d98cd50c-351f-45f0-b966-6d5f1b9c780c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:28.701546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d98cd50c-351f-45f0-b966-6d5f1b9c780c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:28.701997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d98cd50c-351f-45f0-b966-6d5f1b9c780c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:28.702761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d98cd50c-351f-45f0-b966-6d5f1b9c780c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:28.703203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d98cd50c-351f-45f0-b966-6d5f1b9c780c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:28.723271 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f08da710-4f5a-457a-88e7-834369bebd45 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:28.724358 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f08da710-4f5a-457a-88e7-834369bebd45 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:28.733261 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f08da710-4f5a-457a-88e7-834369bebd45 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:28.734431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f08da710-4f5a-457a-88e7-834369bebd45 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:28.735258 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f08da710-4f5a-457a-88e7-834369bebd45 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:28.735759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f08da710-4f5a-457a-88e7-834369bebd45 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:28.759703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:28.850088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d98cd50c-351f-45f0-b966-6d5f1b9c780c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:28.858084 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d98cd50c-351f-45f0-b966-6d5f1b9c780c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.167005 Aug 02 08:55:28.859219 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 118/251] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:28 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:28.863971 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ebfcc8a2-fc69-4572-93ca-ebc8dab297fc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:28.864615 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ebfcc8a2-fc69-4572-93ca-ebc8dab297fc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:28.871545 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ebfcc8a2-fc69-4572-93ca-ebc8dab297fc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:28.871984 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ebfcc8a2-fc69-4572-93ca-ebc8dab297fc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:28.872825 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ebfcc8a2-fc69-4572-93ca-ebc8dab297fc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:28.873306 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ebfcc8a2-fc69-4572-93ca-ebc8dab297fc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:29.017619 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ebfcc8a2-fc69-4572-93ca-ebc8dab297fc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:29.026152 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ebfcc8a2-fc69-4572-93ca-ebc8dab297fc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.165568 Aug 02 08:55:29.026944 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 119/252] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:28 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:29.113144 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f08da710-4f5a-457a-88e7-834369bebd45 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:29.121622 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f08da710-4f5a-457a-88e7-834369bebd45 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.407136 Aug 02 08:55:29.122217 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 134/253] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:28 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:29.879527 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-93ada1d9-ea0f-40f9-b277-0268595c6c64 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:29.880154 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-93ada1d9-ea0f-40f9-b277-0268595c6c64 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:29.886169 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-93ada1d9-ea0f-40f9-b277-0268595c6c64 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:29.886635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-93ada1d9-ea0f-40f9-b277-0268595c6c64 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:29.887388 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-93ada1d9-ea0f-40f9-b277-0268595c6c64 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:29.887820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-93ada1d9-ea0f-40f9-b277-0268595c6c64 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:30.022616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-93ada1d9-ea0f-40f9-b277-0268595c6c64 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:30.030183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-93ada1d9-ea0f-40f9-b277-0268595c6c64 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.154477 Aug 02 08:55:30.031403 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 120/254] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:29 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:30.050839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-19e58b7b-ab80-4a43-8f31-ddb92a5edff4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:30.051609 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-19e58b7b-ab80-4a43-8f31-ddb92a5edff4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:30.058127 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19e58b7b-ab80-4a43-8f31-ddb92a5edff4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:30.058580 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19e58b7b-ab80-4a43-8f31-ddb92a5edff4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:30.059370 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19e58b7b-ab80-4a43-8f31-ddb92a5edff4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:30.059804 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19e58b7b-ab80-4a43-8f31-ddb92a5edff4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:30.143832 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-14443ccc-bc60-42cd-8d25-8f95d571ba24 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:30.145975 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-14443ccc-bc60-42cd-8d25-8f95d571ba24 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:30.150581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-14443ccc-bc60-42cd-8d25-8f95d571ba24 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:30.151071 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-14443ccc-bc60-42cd-8d25-8f95d571ba24 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:30.151920 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-14443ccc-bc60-42cd-8d25-8f95d571ba24 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:30.152521 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-14443ccc-bc60-42cd-8d25-8f95d571ba24 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:30.198163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-19e58b7b-ab80-4a43-8f31-ddb92a5edff4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:30.210512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-19e58b7b-ab80-4a43-8f31-ddb92a5edff4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.164796 Aug 02 08:55:30.215443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 135/255] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:30 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:30.289655 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-14443ccc-bc60-42cd-8d25-8f95d571ba24 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:30.297557 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-14443ccc-bc60-42cd-8d25-8f95d571ba24 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.157957 Aug 02 08:55:30.298130 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 121/256] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:30 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:31.052470 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a036104f-9fc4-41f0-aaf7-bf2b2325c394 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:31.053399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a036104f-9fc4-41f0-aaf7-bf2b2325c394 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:31.060316 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a036104f-9fc4-41f0-aaf7-bf2b2325c394 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:31.060700 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a036104f-9fc4-41f0-aaf7-bf2b2325c394 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:31.061704 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a036104f-9fc4-41f0-aaf7-bf2b2325c394 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:31.061891 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a036104f-9fc4-41f0-aaf7-bf2b2325c394 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:31.198514 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a036104f-9fc4-41f0-aaf7-bf2b2325c394 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:31.206231 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a036104f-9fc4-41f0-aaf7-bf2b2325c394 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.159043 Aug 02 08:55:31.206786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 136/257] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:31 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:31.233118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-78c05cae-b88d-4455-9450-3501206587a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:31.233727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-78c05cae-b88d-4455-9450-3501206587a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:31.236399 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=4 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:31.237123 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=18 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:31.243348 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78c05cae-b88d-4455-9450-3501206587a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:31.243875 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78c05cae-b88d-4455-9450-3501206587a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:31.244686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78c05cae-b88d-4455-9450-3501206587a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:31.245127 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78c05cae-b88d-4455-9450-3501206587a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:31.318629 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c21ab0be-49ba-469c-8e1d-6d195b8eff97 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:31.319140 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c21ab0be-49ba-469c-8e1d-6d195b8eff97 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:31.325187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c21ab0be-49ba-469c-8e1d-6d195b8eff97 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:31.325822 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c21ab0be-49ba-469c-8e1d-6d195b8eff97 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:31.327242 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c21ab0be-49ba-469c-8e1d-6d195b8eff97 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:31.328178 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c21ab0be-49ba-469c-8e1d-6d195b8eff97 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:31.380517 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-78c05cae-b88d-4455-9450-3501206587a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:31.387887 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-78c05cae-b88d-4455-9450-3501206587a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.158670 Aug 02 08:55:31.388519 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 122/258] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:31 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:31.466709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c21ab0be-49ba-469c-8e1d-6d195b8eff97 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:31.475114 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c21ab0be-49ba-469c-8e1d-6d195b8eff97 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.160382 Aug 02 08:55:31.475684 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 137/259] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:31 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:32.227578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e4bd5aa8-a9d9-45cc-9451-6fb8023793ba tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:32.228198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e4bd5aa8-a9d9-45cc-9451-6fb8023793ba tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:32.234351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e4bd5aa8-a9d9-45cc-9451-6fb8023793ba tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:32.234939 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e4bd5aa8-a9d9-45cc-9451-6fb8023793ba tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:32.235532 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e4bd5aa8-a9d9-45cc-9451-6fb8023793ba tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:32.235961 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e4bd5aa8-a9d9-45cc-9451-6fb8023793ba tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:32.373462 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e4bd5aa8-a9d9-45cc-9451-6fb8023793ba tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:32.381791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e4bd5aa8-a9d9-45cc-9451-6fb8023793ba tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.158036 Aug 02 08:55:32.382466 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 123/260] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:32 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:32.410045 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-db687a41-7ff4-4f87-84c1-793f00749398 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:32.410658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-db687a41-7ff4-4f87-84c1-793f00749398 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:32.417989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-db687a41-7ff4-4f87-84c1-793f00749398 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:32.418401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-db687a41-7ff4-4f87-84c1-793f00749398 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:32.419561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-db687a41-7ff4-4f87-84c1-793f00749398 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:32.420213 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-db687a41-7ff4-4f87-84c1-793f00749398 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:32.496308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0bda80c4-d279-4500-a9e5-2609eb4dd80f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:32.496919 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0bda80c4-d279-4500-a9e5-2609eb4dd80f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:32.503245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0bda80c4-d279-4500-a9e5-2609eb4dd80f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:32.503377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0bda80c4-d279-4500-a9e5-2609eb4dd80f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:32.504072 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0bda80c4-d279-4500-a9e5-2609eb4dd80f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:32.504533 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0bda80c4-d279-4500-a9e5-2609eb4dd80f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:32.556379 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-db687a41-7ff4-4f87-84c1-793f00749398 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:32.563794 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-db687a41-7ff4-4f87-84c1-793f00749398 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.158191 Aug 02 08:55:32.564418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 138/261] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:32 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:32.637332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0bda80c4-d279-4500-a9e5-2609eb4dd80f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:32.645205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0bda80c4-d279-4500-a9e5-2609eb4dd80f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.152777 Aug 02 08:55:32.645822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 124/262] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:32 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:33.403910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8968f168-7c7d-4373-8e7e-3d65d96ecc2a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:33.403910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8968f168-7c7d-4373-8e7e-3d65d96ecc2a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:33.410106 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8968f168-7c7d-4373-8e7e-3d65d96ecc2a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:33.410657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8968f168-7c7d-4373-8e7e-3d65d96ecc2a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:33.411320 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8968f168-7c7d-4373-8e7e-3d65d96ecc2a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:33.411760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8968f168-7c7d-4373-8e7e-3d65d96ecc2a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:33.551212 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8968f168-7c7d-4373-8e7e-3d65d96ecc2a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:33.558773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8968f168-7c7d-4373-8e7e-3d65d96ecc2a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.159945 Aug 02 08:55:33.559334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 139/263] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:33 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:33.585765 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d01f05b4-64a7-479f-a170-45a235935239 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:33.586376 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d01f05b4-64a7-479f-a170-45a235935239 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:33.592623 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d01f05b4-64a7-479f-a170-45a235935239 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:33.593134 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d01f05b4-64a7-479f-a170-45a235935239 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:33.593928 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d01f05b4-64a7-479f-a170-45a235935239 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:33.594369 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d01f05b4-64a7-479f-a170-45a235935239 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:33.666027 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8c779178-ced3-49d4-997b-83e66f80e555 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:33.666554 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8c779178-ced3-49d4-997b-83e66f80e555 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:33.673172 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8c779178-ced3-49d4-997b-83e66f80e555 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:33.673621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8c779178-ced3-49d4-997b-83e66f80e555 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:33.674400 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8c779178-ced3-49d4-997b-83e66f80e555 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:33.674841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8c779178-ced3-49d4-997b-83e66f80e555 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:33.732148 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d01f05b4-64a7-479f-a170-45a235935239 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:33.742084 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d01f05b4-64a7-479f-a170-45a235935239 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.160895 Aug 02 08:55:33.742673 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 125/264] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:33 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:33.823784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8c779178-ced3-49d4-997b-83e66f80e555 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:33.831812 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8c779178-ced3-49d4-997b-83e66f80e555 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1318 microversion: 2.1 time: 0.169825 Aug 02 08:55:33.832387 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 140/265] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:33 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:34.580258 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c0cce3aa-7963-4d3c-b3e8-82f91be7e68b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:34.580870 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c0cce3aa-7963-4d3c-b3e8-82f91be7e68b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:34.587871 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0cce3aa-7963-4d3c-b3e8-82f91be7e68b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:34.588473 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0cce3aa-7963-4d3c-b3e8-82f91be7e68b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:34.589103 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0cce3aa-7963-4d3c-b3e8-82f91be7e68b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:34.589540 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0cce3aa-7963-4d3c-b3e8-82f91be7e68b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:34.719216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c0cce3aa-7963-4d3c-b3e8-82f91be7e68b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:34.722627 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=100 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:34.727632 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c0cce3aa-7963-4d3c-b3e8-82f91be7e68b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.151191 Aug 02 08:55:34.728398 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 126/266] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:34 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:34.762917 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-bf7bb7d4-e1a9-4324-8e56-d41366088b3d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:34.763529 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-bf7bb7d4-e1a9-4324-8e56-d41366088b3d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:34.770638 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bf7bb7d4-e1a9-4324-8e56-d41366088b3d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:34.771090 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bf7bb7d4-e1a9-4324-8e56-d41366088b3d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:34.771858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bf7bb7d4-e1a9-4324-8e56-d41366088b3d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:34.772344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bf7bb7d4-e1a9-4324-8e56-d41366088b3d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:34.853406 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6e9523b5-40c4-4b32-b2d8-d5703458d31f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:34.854015 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6e9523b5-40c4-4b32-b2d8-d5703458d31f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:34.860342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e9523b5-40c4-4b32-b2d8-d5703458d31f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:34.860687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e9523b5-40c4-4b32-b2d8-d5703458d31f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:34.861457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e9523b5-40c4-4b32-b2d8-d5703458d31f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:34.861890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e9523b5-40c4-4b32-b2d8-d5703458d31f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:34.910979 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-bf7bb7d4-e1a9-4324-8e56-d41366088b3d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:34.919191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-bf7bb7d4-e1a9-4324-8e56-d41366088b3d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.159986 Aug 02 08:55:34.927026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 141/267] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:34 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:35.013195 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6e9523b5-40c4-4b32-b2d8-d5703458d31f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:35.022180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6e9523b5-40c4-4b32-b2d8-d5703458d31f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1507 microversion: 2.1 time: 0.172947 Aug 02 08:55:35.022868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 127/268] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:34 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:35.752289 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7edeaf52-03b3-4f0f-b4ca-8d7d1c32df56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:35.752289 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7edeaf52-03b3-4f0f-b4ca-8d7d1c32df56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:35.778074 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7edeaf52-03b3-4f0f-b4ca-8d7d1c32df56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:35.778680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7edeaf52-03b3-4f0f-b4ca-8d7d1c32df56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:35.779292 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7edeaf52-03b3-4f0f-b4ca-8d7d1c32df56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:35.779730 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7edeaf52-03b3-4f0f-b4ca-8d7d1c32df56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:35.942534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7e7c73fe-ddf7-443e-840e-9398970dbd7c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:35.943734 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7e7c73fe-ddf7-443e-840e-9398970dbd7c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:35.953399 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:35.957094 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7e7c73fe-ddf7-443e-840e-9398970dbd7c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:35.959566 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7e7c73fe-ddf7-443e-840e-9398970dbd7c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:35.962196 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7e7c73fe-ddf7-443e-840e-9398970dbd7c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:35.963261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7e7c73fe-ddf7-443e-840e-9398970dbd7c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:36.063289 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7edeaf52-03b3-4f0f-b4ca-8d7d1c32df56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:36.071941 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7edeaf52-03b3-4f0f-b4ca-8d7d1c32df56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.325337 Aug 02 08:55:36.072637 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 142/269] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:35 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:36.124329 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7e7c73fe-ddf7-443e-840e-9398970dbd7c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:36.138062 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7e7c73fe-ddf7-443e-840e-9398970dbd7c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.200443 Aug 02 08:55:36.138814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 128/270] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:35 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:37.094270 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3aaab496-bbc9-4403-9d2d-593265056da2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:37.095002 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3aaab496-bbc9-4403-9d2d-593265056da2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:37.102470 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3aaab496-bbc9-4403-9d2d-593265056da2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:37.103026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3aaab496-bbc9-4403-9d2d-593265056da2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:37.103879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3aaab496-bbc9-4403-9d2d-593265056da2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:37.104507 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3aaab496-bbc9-4403-9d2d-593265056da2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:37.159122 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1037e1dc-1f4d-4d34-8068-a4c4161c2bb9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:37.160282 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1037e1dc-1f4d-4d34-8068-a4c4161c2bb9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:37.168407 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1037e1dc-1f4d-4d34-8068-a4c4161c2bb9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:37.168859 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1037e1dc-1f4d-4d34-8068-a4c4161c2bb9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:37.169859 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1037e1dc-1f4d-4d34-8068-a4c4161c2bb9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:37.170296 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1037e1dc-1f4d-4d34-8068-a4c4161c2bb9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:37.267486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3aaab496-bbc9-4403-9d2d-593265056da2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:37.276297 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3aaab496-bbc9-4403-9d2d-593265056da2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.185656 Aug 02 08:55:37.276894 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 143/271] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:37 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:37.325372 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1037e1dc-1f4d-4d34-8068-a4c4161c2bb9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:37.334554 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1037e1dc-1f4d-4d34-8068-a4c4161c2bb9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.179411 Aug 02 08:55:37.335383 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 129/272] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:37 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:37.640306 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-2aef49d4-afca-4254-a288-3e581f3056c3 req-052058f9-91d0-4ad3-b957-3242753d0522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f712963-5f32-4332-b6e9-30269a5dccd1", "name": "network-vif-plugged", "status": "completed", "tag": "17befc5d-ad61-4c20-abc2-eb77700b5813"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:37.650716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-2aef49d4-afca-4254-a288-3e581f3056c3 req-052058f9-91d0-4ad3-b957-3242753d0522 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:37.651163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-2aef49d4-afca-4254-a288-3e581f3056c3 req-052058f9-91d0-4ad3-b957-3242753d0522 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:37.664162 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-2aef49d4-afca-4254-a288-3e581f3056c3 req-052058f9-91d0-4ad3-b957-3242753d0522 service nova] Creating event network-vif-plugged:17befc5d-ad61-4c20-abc2-eb77700b5813 for instance 8f712963-5f32-4332-b6e9-30269a5dccd1 on hv-cinder-78729 Aug 02 08:55:37.670046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-2aef49d4-afca-4254-a288-3e581f3056c3 req-052058f9-91d0-4ad3-b957-3242753d0522 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034078 Aug 02 08:55:37.671748 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 144/273] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:38.302183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-10dcf42f-0ae3-48f9-9e15-87ae64dd2551 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:38.302939 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-10dcf42f-0ae3-48f9-9e15-87ae64dd2551 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:38.309841 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-10dcf42f-0ae3-48f9-9e15-87ae64dd2551 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:38.310305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-10dcf42f-0ae3-48f9-9e15-87ae64dd2551 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:38.311077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-10dcf42f-0ae3-48f9-9e15-87ae64dd2551 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:38.311511 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-10dcf42f-0ae3-48f9-9e15-87ae64dd2551 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:38.356862 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-471a1420-6954-440f-8ff1-48cc61b4922f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:38.357579 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-471a1420-6954-440f-8ff1-48cc61b4922f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:38.364543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-471a1420-6954-440f-8ff1-48cc61b4922f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:38.364996 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-471a1420-6954-440f-8ff1-48cc61b4922f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:38.365775 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-471a1420-6954-440f-8ff1-48cc61b4922f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:38.366216 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-471a1420-6954-440f-8ff1-48cc61b4922f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:38.446569 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-10dcf42f-0ae3-48f9-9e15-87ae64dd2551 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:38.454732 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-10dcf42f-0ae3-48f9-9e15-87ae64dd2551 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.158223 Aug 02 08:55:38.455301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 130/274] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:38 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:38.499275 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-471a1420-6954-440f-8ff1-48cc61b4922f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:38.507356 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-471a1420-6954-440f-8ff1-48cc61b4922f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.154860 Aug 02 08:55:38.507917 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 145/275] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:38 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:39.476789 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b9d665ff-cb12-4861-80a5-b45c9a831b13 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:39.477345 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b9d665ff-cb12-4861-80a5-b45c9a831b13 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:39.483458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b9d665ff-cb12-4861-80a5-b45c9a831b13 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:39.483901 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b9d665ff-cb12-4861-80a5-b45c9a831b13 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:39.484701 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b9d665ff-cb12-4861-80a5-b45c9a831b13 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:39.485138 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b9d665ff-cb12-4861-80a5-b45c9a831b13 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:39.530118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-aa43218a-3f64-426d-8754-d3e7db739ed9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:39.530831 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-aa43218a-3f64-426d-8754-d3e7db739ed9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:39.537873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa43218a-3f64-426d-8754-d3e7db739ed9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:39.538410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa43218a-3f64-426d-8754-d3e7db739ed9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:39.539263 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa43218a-3f64-426d-8754-d3e7db739ed9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:39.539768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa43218a-3f64-426d-8754-d3e7db739ed9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:39.621513 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b9d665ff-cb12-4861-80a5-b45c9a831b13 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:39.629088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b9d665ff-cb12-4861-80a5-b45c9a831b13 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.156845 Aug 02 08:55:39.629696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 131/276] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:39 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:39.685559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-aa43218a-3f64-426d-8754-d3e7db739ed9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:39.693428 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-aa43218a-3f64-426d-8754-d3e7db739ed9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.167444 Aug 02 08:55:39.694015 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 146/277] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:39 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:40.649882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0b66faff-cfc7-4d9a-857c-c4f7e6822d88 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:40.650498 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0b66faff-cfc7-4d9a-857c-c4f7e6822d88 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:40.656589 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0b66faff-cfc7-4d9a-857c-c4f7e6822d88 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:40.657042 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0b66faff-cfc7-4d9a-857c-c4f7e6822d88 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:40.657830 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0b66faff-cfc7-4d9a-857c-c4f7e6822d88 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:40.658268 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0b66faff-cfc7-4d9a-857c-c4f7e6822d88 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:40.714762 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b0c23759-16ea-4b93-89c9-9e7ab2d4fa3b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:40.715370 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b0c23759-16ea-4b93-89c9-9e7ab2d4fa3b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:40.722039 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b0c23759-16ea-4b93-89c9-9e7ab2d4fa3b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:40.722491 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b0c23759-16ea-4b93-89c9-9e7ab2d4fa3b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:40.723293 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b0c23759-16ea-4b93-89c9-9e7ab2d4fa3b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:40.723729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b0c23759-16ea-4b93-89c9-9e7ab2d4fa3b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:40.795899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0b66faff-cfc7-4d9a-857c-c4f7e6822d88 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:40.805402 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0b66faff-cfc7-4d9a-857c-c4f7e6822d88 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.159349 Aug 02 08:55:40.805976 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 132/278] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:40 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:40.871442 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b0c23759-16ea-4b93-89c9-9e7ab2d4fa3b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:40.878885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b0c23759-16ea-4b93-89c9-9e7ab2d4fa3b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1367 microversion: 2.1 time: 0.167988 Aug 02 08:55:40.879443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 147/279] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:40 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:41.826018 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-bac3a0d5-10bb-4328-b849-83d54df82d7a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:41.826620 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-bac3a0d5-10bb-4328-b849-83d54df82d7a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:41.833166 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bac3a0d5-10bb-4328-b849-83d54df82d7a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:41.833672 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bac3a0d5-10bb-4328-b849-83d54df82d7a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:41.834477 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bac3a0d5-10bb-4328-b849-83d54df82d7a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:41.834861 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bac3a0d5-10bb-4328-b849-83d54df82d7a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:41.901658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5a83ab54-410c-4df2-9a77-bda828529e5e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:41.902360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5a83ab54-410c-4df2-9a77-bda828529e5e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:41.909553 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5a83ab54-410c-4df2-9a77-bda828529e5e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:41.910007 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5a83ab54-410c-4df2-9a77-bda828529e5e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:41.910800 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5a83ab54-410c-4df2-9a77-bda828529e5e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:41.911247 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5a83ab54-410c-4df2-9a77-bda828529e5e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:41.984361 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-bac3a0d5-10bb-4328-b849-83d54df82d7a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:41.992650 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-bac3a0d5-10bb-4328-b849-83d54df82d7a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.170437 Aug 02 08:55:41.993285 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 133/280] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:41 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:42.040951 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5a83ab54-410c-4df2-9a77-bda828529e5e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:42.048527 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5a83ab54-410c-4df2-9a77-bda828529e5e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1556 microversion: 2.1 time: 0.151219 Aug 02 08:55:42.049084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 148/281] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:41 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:42.069684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b36f2729-bf8e-4886-b909-c46085e538cc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:42.070172 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b36f2729-bf8e-4886-b909-c46085e538cc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:42.076368 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b36f2729-bf8e-4886-b909-c46085e538cc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:42.076824 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b36f2729-bf8e-4886-b909-c46085e538cc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:42.077596 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b36f2729-bf8e-4886-b909-c46085e538cc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:42.078041 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b36f2729-bf8e-4886-b909-c46085e538cc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:42.154359 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b36f2729-bf8e-4886-b909-c46085e538cc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088422 Aug 02 08:55:42.156705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 134/282] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 2 08:55:42 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:43.013419 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a31b2f7b-37ce-42f2-8878-12523a972f58 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:43.014165 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a31b2f7b-37ce-42f2-8878-12523a972f58 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:43.020682 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a31b2f7b-37ce-42f2-8878-12523a972f58 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.021788 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a31b2f7b-37ce-42f2-8878-12523a972f58 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.022615 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a31b2f7b-37ce-42f2-8878-12523a972f58 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.023058 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a31b2f7b-37ce-42f2-8878-12523a972f58 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.156147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a31b2f7b-37ce-42f2-8878-12523a972f58 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:43.164292 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a31b2f7b-37ce-42f2-8878-12523a972f58 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1502 microversion: 2.1 time: 0.154678 Aug 02 08:55:43.164907 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 149/283] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:43 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:43.187214 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfad6140-5240-488e-b221-b16c44b081e6"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:43.191019 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:43.198650 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.199099 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.200086 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.200548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.226885 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] HTTP exception thrown: Cannot 'attach_volume' instance 64a7f63d-5a88-4149-ba8c-843268dae669 while it is in vm_state rescued Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Request method failure captured: Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: POST /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669/os-volume_attachments HTTP/1.1 Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 74 Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYZjNzYbJ5mBqiE2yw1T0csKVjkN2yeNeBhK5jIkJf5Xit2MLjbd0yqZmm99CJaCh5ZZdqFbBlu92hhdlw-EYz45f_0D2SOxrdE-bMHcZ779szT2Jp0xIviqccPasp-mq_6P3R4IDJb3Df1HoMqvay8wfKTym7FTWpIoNgdlwBZpl4 Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 08:55:43.228812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4c886ec53c84d5d9542ab7dbbdfcf8b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}] Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 7ed1be3a1ae249828caa8b88fd606557 Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {"volumeAttachment": {"volumeId": "dfad6140-5240-488e-b221-b16c44b081e6"}} Aug 02 08:55:43.230391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Cannot 'attach_volume' instance 64a7f63d-5a88-4149-ba8c-843268dae669 while it is in vm_state rescued Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'server_id': '64a7f63d-5a88-4149-ba8c-843268dae669', 'body': {'volumeAttachment': {'volumeId': 'dfad6140-5240-488e-b221-b16c44b081e6'}}} Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64a7f63d-5a88-4149-ba8c-843268dae669 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:55:43.231291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 64a7f63d-5a88-4149-ba8c-843268dae669 while it is in vm_state rescued Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:55:43.232864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:55:43.234153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:55:43.234153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:55:43.234153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 64a7f63d-5a88-4149-ba8c-843268dae669 while it is in vm_state rescued Aug 02 08:55:43.234153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:55:43.234153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Returning 409 to user: Cannot 'attach_volume' instance 64a7f63d-5a88-4149-ba8c-843268dae669 while it is in vm_state rescued {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:55:43.234153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-052e18b2-9888-4549-9d1f-f880bcaa9a50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048838 Aug 02 08:55:43.234153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 135/284] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 08:55:43 2022] POST /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 08:55:43.239569 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ec6fe785-984f-44b0-9ffa-5fe07139d05c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:43.240642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ec6fe785-984f-44b0-9ffa-5fe07139d05c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:43.242602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=68 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:43.248135 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ec6fe785-984f-44b0-9ffa-5fe07139d05c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.248615 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ec6fe785-984f-44b0-9ffa-5fe07139d05c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.249383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ec6fe785-984f-44b0-9ffa-5fe07139d05c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.249822 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ec6fe785-984f-44b0-9ffa-5fe07139d05c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.307257 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:55:43.316983 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ec6fe785-984f-44b0-9ffa-5fe07139d05c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669/action" status: 202 len: 0 microversion: 2.1 time: 0.081208 Aug 02 08:55:43.317634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 150/285] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 08:55:43 2022] POST /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:55:43.326418 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20c2eea7-447a-4140-9244-034b115a765a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:43.327096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-20c2eea7-447a-4140-9244-034b115a765a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:43.334081 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20c2eea7-447a-4140-9244-034b115a765a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.334588 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20c2eea7-447a-4140-9244-034b115a765a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.335520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20c2eea7-447a-4140-9244-034b115a765a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.336110 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20c2eea7-447a-4140-9244-034b115a765a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.622815 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20c2eea7-447a-4140-9244-034b115a765a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:43.632307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-20c2eea7-447a-4140-9244-034b115a765a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1510 microversion: 2.1 time: 0.309742 Aug 02 08:55:43.632899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 136/286] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:43 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:43.874556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-51caa0d5-9cda-4edb-9bb8-8b75522c3306 req-78e00c1f-4dc6-49b1-967e-04d3b87328da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f712963-5f32-4332-b6e9-30269a5dccd1", "tag": "17befc5d-ad61-4c20-abc2-eb77700b5813"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:43.891207 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-51caa0d5-9cda-4edb-9bb8-8b75522c3306 req-78e00c1f-4dc6-49b1-967e-04d3b87328da service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:43.892462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-51caa0d5-9cda-4edb-9bb8-8b75522c3306 req-78e00c1f-4dc6-49b1-967e-04d3b87328da service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:43.907125 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-51caa0d5-9cda-4edb-9bb8-8b75522c3306 req-78e00c1f-4dc6-49b1-967e-04d3b87328da service nova] Creating event network-changed:17befc5d-ad61-4c20-abc2-eb77700b5813 for instance 8f712963-5f32-4332-b6e9-30269a5dccd1 on hv-cinder-78729 Aug 02 08:55:43.912035 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-51caa0d5-9cda-4edb-9bb8-8b75522c3306 req-78e00c1f-4dc6-49b1-967e-04d3b87328da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045096 Aug 02 08:55:43.912747 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 151/287] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:44.655439 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-056cdac8-9d1d-4f01-84c4-87350336d7ef tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:44.656060 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-056cdac8-9d1d-4f01-84c4-87350336d7ef tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:44.662936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-056cdac8-9d1d-4f01-84c4-87350336d7ef tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:44.663388 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-056cdac8-9d1d-4f01-84c4-87350336d7ef tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:44.664195 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-056cdac8-9d1d-4f01-84c4-87350336d7ef tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:44.664642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-056cdac8-9d1d-4f01-84c4-87350336d7ef tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:44.959483 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-056cdac8-9d1d-4f01-84c4-87350336d7ef tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:44.967096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-056cdac8-9d1d-4f01-84c4-87350336d7ef tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1510 microversion: 2.1 time: 0.317629 Aug 02 08:55:44.967967 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 137/288] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:44 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1510 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:55:45.992917 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4d6a6b28-962b-4572-a2a3-a48b78a2e917 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:45.993728 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4d6a6b28-962b-4572-a2a3-a48b78a2e917 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:45.999868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4d6a6b28-962b-4572-a2a3-a48b78a2e917 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:46.000353 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4d6a6b28-962b-4572-a2a3-a48b78a2e917 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:46.001122 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4d6a6b28-962b-4572-a2a3-a48b78a2e917 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:46.001557 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4d6a6b28-962b-4572-a2a3-a48b78a2e917 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:46.130080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4d6a6b28-962b-4572-a2a3-a48b78a2e917 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:46.138229 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4d6a6b28-962b-4572-a2a3-a48b78a2e917 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1510 microversion: 2.1 time: 0.150520 Aug 02 08:55:46.138783 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 152/289] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:45 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:47.159619 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4d118b19-fa9e-4dfa-bad6-070ee2841f9f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:47.160262 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4d118b19-fa9e-4dfa-bad6-070ee2841f9f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:47.166938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4d118b19-fa9e-4dfa-bad6-070ee2841f9f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:47.167395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4d118b19-fa9e-4dfa-bad6-070ee2841f9f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:47.168194 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4d118b19-fa9e-4dfa-bad6-070ee2841f9f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:47.168639 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4d118b19-fa9e-4dfa-bad6-070ee2841f9f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:47.296028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4d118b19-fa9e-4dfa-bad6-070ee2841f9f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:47.303422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4d118b19-fa9e-4dfa-bad6-070ee2841f9f tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1510 microversion: 2.1 time: 0.147687 Aug 02 08:55:47.303989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 138/290] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:47 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:48.325093 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-65f56203-4df2-4c6e-8347-785a29c53bf3 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:48.325624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-65f56203-4df2-4c6e-8347-785a29c53bf3 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:48.332885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-65f56203-4df2-4c6e-8347-785a29c53bf3 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:48.333343 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-65f56203-4df2-4c6e-8347-785a29c53bf3 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:48.334112 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-65f56203-4df2-4c6e-8347-785a29c53bf3 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:48.334554 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-65f56203-4df2-4c6e-8347-785a29c53bf3 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:48.463785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-65f56203-4df2-4c6e-8347-785a29c53bf3 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:48.471332 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-65f56203-4df2-4c6e-8347-785a29c53bf3 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1510 microversion: 2.1 time: 0.150220 Aug 02 08:55:48.471895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 153/291] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:48 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:49.493305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6d1b6c79-5daa-4d56-8481-71eae3c21f6e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:49.493911 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6d1b6c79-5daa-4d56-8481-71eae3c21f6e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:49.499938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d1b6c79-5daa-4d56-8481-71eae3c21f6e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:49.500412 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d1b6c79-5daa-4d56-8481-71eae3c21f6e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:49.501172 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d1b6c79-5daa-4d56-8481-71eae3c21f6e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:49.501605 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d1b6c79-5daa-4d56-8481-71eae3c21f6e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:49.631657 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6d1b6c79-5daa-4d56-8481-71eae3c21f6e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:49.640203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6d1b6c79-5daa-4d56-8481-71eae3c21f6e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1510 microversion: 2.1 time: 0.150985 Aug 02 08:55:49.660195 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 139/292] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:49 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:50.661170 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-98af075e-5f27-4a82-9563-673d3e59aace tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:50.661823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-98af075e-5f27-4a82-9563-673d3e59aace tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:50.668840 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-98af075e-5f27-4a82-9563-673d3e59aace tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:50.669288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-98af075e-5f27-4a82-9563-673d3e59aace tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:50.670079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-98af075e-5f27-4a82-9563-673d3e59aace tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:50.670518 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-98af075e-5f27-4a82-9563-673d3e59aace tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:50.800691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-98af075e-5f27-4a82-9563-673d3e59aace tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:50.808753 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-98af075e-5f27-4a82-9563-673d3e59aace tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1516 microversion: 2.1 time: 0.151692 Aug 02 08:55:50.809321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 154/293] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:50 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:54.258251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c632cdbe-6c84-497c-9926-6beda942213c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'create', calling method: .version_select at 0x7f13fabc8280>, body: {"keypair": {"name": "tempest-keypair-627452945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3rOGGwtwwGoZRlc0Vty4s8wX1ZJO2WJAdnWtDlGmFUiYmUOHQ0DOYYlQkxDZmpGbEK000l7WVLSvFgSRUtfW60a7SqSqhSabh4mXCGdDGLSeWRdYfP+s5ZFtydLHu/1Q=="}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:54.273501 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-c632cdbe-6c84-497c-9926-6beda942213c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Getting quotas for project a4c886ec53c84d5d9542ab7dbbdfcf8b. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:55:54.277305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-c632cdbe-6c84-497c-9926-6beda942213c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Getting quotas for user 7ed1be3a1ae249828caa8b88fd606557 and project a4c886ec53c84d5d9542ab7dbbdfcf8b. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:55:54.300236 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c632cdbe-6c84-497c-9926-6beda942213c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045817 Aug 02 08:55:54.300833 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 140/294] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 08:55:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:55.571454 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1108756190", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30dcf16f-3811-475b-b954-f6d604e51a35"}], "security_groups": [{"name": "tempest-securitygroup--891843170"}], "key_name": "tempest-keypair-627452945", "user_data": "}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:55.673938 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] validate_networks() for [('30dcf16f-3811-475b-b954-f6d604e51a35', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:55:56.041916 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:55:56.042341 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:55:56.042818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:55:56.043224 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:55:56.043635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:55:56.052869 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:56.053338 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:56.054127 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:56.055187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:56.072247 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Getting quotas for project a4c886ec53c84d5d9542ab7dbbdfcf8b. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:55:56.076205 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Getting quotas for user 7ed1be3a1ae249828caa8b88fd606557 and project a4c886ec53c84d5d9542ab7dbbdfcf8b. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:55:56.087137 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:55:56.089406 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:55:56.135922 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e842cb93-fe74-45b5-92e5-b8191db84652 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.569229 Aug 02 08:55:56.136592 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 155/295] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:55:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:55:56.147204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-87bf49a6-ed48-49fd-b7cb-a5da2eb5a2a5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:56.147805 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-87bf49a6-ed48-49fd-b7cb-a5da2eb5a2a5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:56.202796 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-87bf49a6-ed48-49fd-b7cb-a5da2eb5a2a5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:56.209940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-87bf49a6-ed48-49fd-b7cb-a5da2eb5a2a5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1245 microversion: 2.1 time: 0.066540 Aug 02 08:55:56.210526 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 141/296] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:56 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:57.231233 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8663decd-8259-4071-889f-d5a98fdc7a56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:57.232014 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8663decd-8259-4071-889f-d5a98fdc7a56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:57.240071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8663decd-8259-4071-889f-d5a98fdc7a56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:57.240559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8663decd-8259-4071-889f-d5a98fdc7a56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:57.241368 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8663decd-8259-4071-889f-d5a98fdc7a56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:57.242416 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8663decd-8259-4071-889f-d5a98fdc7a56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:57.306955 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8663decd-8259-4071-889f-d5a98fdc7a56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:57.314891 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8663decd-8259-4071-889f-d5a98fdc7a56 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1305 microversion: 2.1 time: 0.087761 Aug 02 08:55:57.315457 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 156/297] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:57 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:58.338986 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6ba30470-e6fe-4f4f-a255-3a74b13bedad tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:58.339710 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6ba30470-e6fe-4f4f-a255-3a74b13bedad tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:58.347823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6ba30470-e6fe-4f4f-a255-3a74b13bedad tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:58.348405 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6ba30470-e6fe-4f4f-a255-3a74b13bedad tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:58.349366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6ba30470-e6fe-4f4f-a255-3a74b13bedad tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:58.349938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6ba30470-e6fe-4f4f-a255-3a74b13bedad tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:58.591823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6ba30470-e6fe-4f4f-a255-3a74b13bedad tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:58.599939 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6ba30470-e6fe-4f4f-a255-3a74b13bedad tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.266167 Aug 02 08:55:58.600546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 142/298] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:58 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:55:58.918626 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-1b880d96-88ec-48cb-96b2-b1726a03946c req-8c4ab6ef-d20b-4476-9124-81a15b3b3222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f003d009-ff7f-402b-8909-26d0e4ed705a", "tag": "5a62ab27-1e19-43ae-907f-3e801613a1ff"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:55:58.930378 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-1b880d96-88ec-48cb-96b2-b1726a03946c req-8c4ab6ef-d20b-4476-9124-81a15b3b3222 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:58.930884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-1b880d96-88ec-48cb-96b2-b1726a03946c req-8c4ab6ef-d20b-4476-9124-81a15b3b3222 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:58.942367 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-1b880d96-88ec-48cb-96b2-b1726a03946c req-8c4ab6ef-d20b-4476-9124-81a15b3b3222 service nova] Creating event network-changed:5a62ab27-1e19-43ae-907f-3e801613a1ff for instance f003d009-ff7f-402b-8909-26d0e4ed705a on hv-cinder-78729 Aug 02 08:55:58.947838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-1b880d96-88ec-48cb-96b2-b1726a03946c req-8c4ab6ef-d20b-4476-9124-81a15b3b3222 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032912 Aug 02 08:55:58.948656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 157/299] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:55:59.621267 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-61c438b4-556a-4c4b-b95d-50e027c74403 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:55:59.621874 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-61c438b4-556a-4c4b-b95d-50e027c74403 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:55:59.627956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-61c438b4-556a-4c4b-b95d-50e027c74403 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:59.628438 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-61c438b4-556a-4c4b-b95d-50e027c74403 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:59.629203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-61c438b4-556a-4c4b-b95d-50e027c74403 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:55:59.629639 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-61c438b4-556a-4c4b-b95d-50e027c74403 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:55:59.760066 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-61c438b4-556a-4c4b-b95d-50e027c74403 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:55:59.771127 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-61c438b4-556a-4c4b-b95d-50e027c74403 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.153394 Aug 02 08:55:59.771994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 143/300] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:55:59 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:00.795722 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f5bd95cb-9101-44d9-9ab3-5c51433f29a4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:00.797099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f5bd95cb-9101-44d9-9ab3-5c51433f29a4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:00.803838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5bd95cb-9101-44d9-9ab3-5c51433f29a4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:00.804829 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5bd95cb-9101-44d9-9ab3-5c51433f29a4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:00.806232 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5bd95cb-9101-44d9-9ab3-5c51433f29a4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:00.806871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5bd95cb-9101-44d9-9ab3-5c51433f29a4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:00.941358 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f5bd95cb-9101-44d9-9ab3-5c51433f29a4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:00.948926 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f5bd95cb-9101-44d9-9ab3-5c51433f29a4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.158428 Aug 02 08:56:00.949488 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 158/301] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:00 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:01.969558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f0ce2137-e091-4d33-8367-000fdc8cc0d9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:01.970162 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f0ce2137-e091-4d33-8367-000fdc8cc0d9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:01.976458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f0ce2137-e091-4d33-8367-000fdc8cc0d9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:01.976923 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f0ce2137-e091-4d33-8367-000fdc8cc0d9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:01.977668 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f0ce2137-e091-4d33-8367-000fdc8cc0d9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:01.978109 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f0ce2137-e091-4d33-8367-000fdc8cc0d9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:02.103746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f0ce2137-e091-4d33-8367-000fdc8cc0d9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:02.111125 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f0ce2137-e091-4d33-8367-000fdc8cc0d9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.145499 Aug 02 08:56:02.111693 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 144/302] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:01 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:03.131449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-68519ee2-5c1e-4e8a-99fd-c89db35340c7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:03.131991 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-68519ee2-5c1e-4e8a-99fd-c89db35340c7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:03.139093 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-68519ee2-5c1e-4e8a-99fd-c89db35340c7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:03.139561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-68519ee2-5c1e-4e8a-99fd-c89db35340c7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:03.140351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-68519ee2-5c1e-4e8a-99fd-c89db35340c7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:03.140795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-68519ee2-5c1e-4e8a-99fd-c89db35340c7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:03.268368 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-68519ee2-5c1e-4e8a-99fd-c89db35340c7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:03.276378 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-68519ee2-5c1e-4e8a-99fd-c89db35340c7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.148849 Aug 02 08:56:03.276927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 159/303] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:03 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:04.295862 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-35229b7c-100a-4fb5-b4f7-bd900c059dce tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:04.296566 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-35229b7c-100a-4fb5-b4f7-bd900c059dce tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:04.302971 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35229b7c-100a-4fb5-b4f7-bd900c059dce tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:04.303421 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35229b7c-100a-4fb5-b4f7-bd900c059dce tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:04.304287 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35229b7c-100a-4fb5-b4f7-bd900c059dce tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:04.304726 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35229b7c-100a-4fb5-b4f7-bd900c059dce tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:04.437772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-35229b7c-100a-4fb5-b4f7-bd900c059dce tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:04.445755 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-35229b7c-100a-4fb5-b4f7-bd900c059dce tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.153721 Aug 02 08:56:04.446377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 145/304] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:04 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:05.467503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1de142b1-ac79-47f1-8ecc-e53d6f06fbca tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:05.468239 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1de142b1-ac79-47f1-8ecc-e53d6f06fbca tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:05.475125 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1de142b1-ac79-47f1-8ecc-e53d6f06fbca tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:05.475650 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1de142b1-ac79-47f1-8ecc-e53d6f06fbca tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:05.476496 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1de142b1-ac79-47f1-8ecc-e53d6f06fbca tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:05.477019 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1de142b1-ac79-47f1-8ecc-e53d6f06fbca tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:05.667160 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1de142b1-ac79-47f1-8ecc-e53d6f06fbca tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:05.674815 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1de142b1-ac79-47f1-8ecc-e53d6f06fbca tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.211648 Aug 02 08:56:05.675384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 160/305] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:05 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:06.696595 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e36ee71e-dd64-41ee-87dd-c4f7037f50d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:06.697197 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e36ee71e-dd64-41ee-87dd-c4f7037f50d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:06.699071 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=6 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:06.699852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:06.705054 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e36ee71e-dd64-41ee-87dd-c4f7037f50d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:06.705497 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e36ee71e-dd64-41ee-87dd-c4f7037f50d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:06.706262 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e36ee71e-dd64-41ee-87dd-c4f7037f50d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:06.706833 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e36ee71e-dd64-41ee-87dd-c4f7037f50d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:06.712564 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=99 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:06.743850 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-ed402d05-4568-4439-a31f-0a1eaf7f030c req-948d2cf4-ffca-4b33-ba7a-fa4346f527f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f003d009-ff7f-402b-8909-26d0e4ed705a", "name": "network-vif-plugged", "status": "completed", "tag": "5a62ab27-1e19-43ae-907f-3e801613a1ff"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:56:06.749131 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:06.749881 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=6 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:06.756703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-ed402d05-4568-4439-a31f-0a1eaf7f030c req-948d2cf4-ffca-4b33-ba7a-fa4346f527f2 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:06.758036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-ed402d05-4568-4439-a31f-0a1eaf7f030c req-948d2cf4-ffca-4b33-ba7a-fa4346f527f2 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:06.772099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-ed402d05-4568-4439-a31f-0a1eaf7f030c req-948d2cf4-ffca-4b33-ba7a-fa4346f527f2 service nova] Creating event network-vif-plugged:5a62ab27-1e19-43ae-907f-3e801613a1ff for instance f003d009-ff7f-402b-8909-26d0e4ed705a on hv-cinder-78729 Aug 02 08:56:06.777792 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-ed402d05-4568-4439-a31f-0a1eaf7f030c req-948d2cf4-ffca-4b33-ba7a-fa4346f527f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037592 Aug 02 08:56:06.778373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 161/306] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:56:06.847613 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e36ee71e-dd64-41ee-87dd-c4f7037f50d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:06.855235 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e36ee71e-dd64-41ee-87dd-c4f7037f50d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.163120 Aug 02 08:56:06.855814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 146/307] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:06 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:07.877164 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-44d6067d-63f3-4c46-ba4c-6027dde7e465 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:07.877863 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-44d6067d-63f3-4c46-ba4c-6027dde7e465 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:07.884215 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-44d6067d-63f3-4c46-ba4c-6027dde7e465 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:07.884667 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-44d6067d-63f3-4c46-ba4c-6027dde7e465 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:07.885429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-44d6067d-63f3-4c46-ba4c-6027dde7e465 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:07.885868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-44d6067d-63f3-4c46-ba4c-6027dde7e465 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:08.017689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-44d6067d-63f3-4c46-ba4c-6027dde7e465 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:08.025574 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-44d6067d-63f3-4c46-ba4c-6027dde7e465 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.153125 Aug 02 08:56:08.026134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 162/308] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:07 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:09.045580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-dc515b5f-f965-49bf-b64a-a40d1a36b8aa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:09.046192 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-dc515b5f-f965-49bf-b64a-a40d1a36b8aa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:09.052244 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc515b5f-f965-49bf-b64a-a40d1a36b8aa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:09.052711 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc515b5f-f965-49bf-b64a-a40d1a36b8aa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:09.053464 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc515b5f-f965-49bf-b64a-a40d1a36b8aa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:09.053903 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc515b5f-f965-49bf-b64a-a40d1a36b8aa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:09.179027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dc515b5f-f965-49bf-b64a-a40d1a36b8aa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:09.187079 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-dc515b5f-f965-49bf-b64a-a40d1a36b8aa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1370 microversion: 2.1 time: 0.145331 Aug 02 08:56:09.187669 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 147/309] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:09 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:10.207094 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-05c4ca44-0570-4880-aaae-d75911f0148d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:10.207906 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-05c4ca44-0570-4880-aaae-d75911f0148d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:10.214052 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-05c4ca44-0570-4880-aaae-d75911f0148d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:10.214508 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-05c4ca44-0570-4880-aaae-d75911f0148d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:10.215288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-05c4ca44-0570-4880-aaae-d75911f0148d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:10.215860 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-05c4ca44-0570-4880-aaae-d75911f0148d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:10.344437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8620f476-3808-43d9-baa5-d1f21a4bdebc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8d19813-9608-42cf-99fc-6a23fbd93b95", "device": "/dev/sdb"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:56:10.347256 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8620f476-3808-43d9-baa5-d1f21a4bdebc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:10.350964 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-05c4ca44-0570-4880-aaae-d75911f0148d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:10.354215 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8620f476-3808-43d9-baa5-d1f21a4bdebc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:10.354794 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8620f476-3808-43d9-baa5-d1f21a4bdebc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:10.355746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8620f476-3808-43d9-baa5-d1f21a4bdebc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:10.356223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8620f476-3808-43d9-baa5-d1f21a4bdebc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:10.358601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-05c4ca44-0570-4880-aaae-d75911f0148d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1564 microversion: 2.1 time: 0.155636 Aug 02 08:56:10.359377 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 163/310] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:10 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:10.379324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-331c302f-be5f-46f3-956d-27a4fe53148b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:10.379817 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-331c302f-be5f-46f3-956d-27a4fe53148b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:10.386610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-331c302f-be5f-46f3-956d-27a4fe53148b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:10.387498 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-331c302f-be5f-46f3-956d-27a4fe53148b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:10.387840 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-331c302f-be5f-46f3-956d-27a4fe53148b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:10.388328 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-331c302f-be5f-46f3-956d-27a4fe53148b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:10.472448 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-331c302f-be5f-46f3-956d-27a4fe53148b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096959 Aug 02 08:56:10.473218 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 164/311] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 2 08:56:10 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:56:10.637813 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8620f476-3808-43d9-baa5-d1f21a4bdebc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "POST /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297664 Aug 02 08:56:10.638523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 148/312] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 08:56:10 2022] POST /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:56:11.412614 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-c1a795bb-34f5-4600-ac79-116b7e06843d req-1fc368e6-829c-4170-9929-66ea7544f833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f003d009-ff7f-402b-8909-26d0e4ed705a", "tag": "5a62ab27-1e19-43ae-907f-3e801613a1ff"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:56:11.422440 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-c1a795bb-34f5-4600-ac79-116b7e06843d req-1fc368e6-829c-4170-9929-66ea7544f833 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:11.423034 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-c1a795bb-34f5-4600-ac79-116b7e06843d req-1fc368e6-829c-4170-9929-66ea7544f833 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:11.434664 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-c1a795bb-34f5-4600-ac79-116b7e06843d req-1fc368e6-829c-4170-9929-66ea7544f833 service nova] Creating event network-changed:5a62ab27-1e19-43ae-907f-3e801613a1ff for instance f003d009-ff7f-402b-8909-26d0e4ed705a on hv-cinder-78729 Aug 02 08:56:11.439556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-c1a795bb-34f5-4600-ac79-116b7e06843d req-1fc368e6-829c-4170-9929-66ea7544f833 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031077 Aug 02 08:56:11.440737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 165/313] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:56:39.476595 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=5 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:39.477363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:39.482594 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-03e81d08-8edf-4fae-871f-81dd9c12d1ec tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:39.483200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-03e81d08-8edf-4fae-871f-81dd9c12d1ec tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:39.491205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03e81d08-8edf-4fae-871f-81dd9c12d1ec tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:39.491656 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03e81d08-8edf-4fae-871f-81dd9c12d1ec tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:39.492449 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03e81d08-8edf-4fae-871f-81dd9c12d1ec tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:39.492889 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03e81d08-8edf-4fae-871f-81dd9c12d1ec tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:39.617924 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-03e81d08-8edf-4fae-871f-81dd9c12d1ec tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lazy-loading 'services' on Instance uuid 4eb4ab28-698c-4f0d-a1a6-932951362ac0 {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:56:39.730340 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-03e81d08-8edf-4fae-871f-81dd9c12d1ec tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0/os-volume_attachments/a8d19813-9608-42cf-99fc-6a23fbd93b95" status: 202 len: 0 microversion: 2.1 time: 0.255007 Aug 02 08:56:39.730970 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 149/314] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 08:56:39 2022] DELETE /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0/os-volume_attachments/a8d19813-9608-42cf-99fc-6a23fbd93b95 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:56:41.908925 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:41.909733 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=68 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:41.914195 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-48afae3d-043f-4ad3-8bc2-b5d0a58557d0 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:41.914772 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-48afae3d-043f-4ad3-8bc2-b5d0a58557d0 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:41.922630 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48afae3d-043f-4ad3-8bc2-b5d0a58557d0 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:41.923080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48afae3d-043f-4ad3-8bc2-b5d0a58557d0 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:41.923856 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48afae3d-043f-4ad3-8bc2-b5d0a58557d0 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:41.924324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48afae3d-043f-4ad3-8bc2-b5d0a58557d0 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:41.948259 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-48afae3d-043f-4ad3-8bc2-b5d0a58557d0 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Going to try to terminate instance {{(pid=117773) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:56:42.031792 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-48afae3d-043f-4ad3-8bc2-b5d0a58557d0 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 204 len: 0 microversion: 2.1 time: 0.124451 Aug 02 08:56:42.032645 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 166/315] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 08:56:41 2022] DELETE /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:56:42.041994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-051c48b6-7f97-4f01-81fb-ec771335e1fd tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:42.042753 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-051c48b6-7f97-4f01-81fb-ec771335e1fd tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:42.048980 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-051c48b6-7f97-4f01-81fb-ec771335e1fd tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:42.049430 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-051c48b6-7f97-4f01-81fb-ec771335e1fd tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:42.050190 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-051c48b6-7f97-4f01-81fb-ec771335e1fd tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:42.050624 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-051c48b6-7f97-4f01-81fb-ec771335e1fd tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:42.181105 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-051c48b6-7f97-4f01-81fb-ec771335e1fd tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:42.188976 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-051c48b6-7f97-4f01-81fb-ec771335e1fd tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1513 microversion: 2.1 time: 0.151616 Aug 02 08:56:42.189535 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 150/316] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:42 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:43.211176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-54eb3d6f-8c28-46cf-8fa5-76e491f42b43 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:43.211884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-54eb3d6f-8c28-46cf-8fa5-76e491f42b43 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:43.218474 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54eb3d6f-8c28-46cf-8fa5-76e491f42b43 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:43.218977 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54eb3d6f-8c28-46cf-8fa5-76e491f42b43 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:43.219724 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54eb3d6f-8c28-46cf-8fa5-76e491f42b43 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:43.220192 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54eb3d6f-8c28-46cf-8fa5-76e491f42b43 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:43.350344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-54eb3d6f-8c28-46cf-8fa5-76e491f42b43 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:43.358543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-54eb3d6f-8c28-46cf-8fa5-76e491f42b43 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1513 microversion: 2.1 time: 0.151856 Aug 02 08:56:43.359107 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 167/317] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:43 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:44.380214 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-cac7dcba-d507-4c50-9c27-2ecfdd0689c6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:44.380840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-cac7dcba-d507-4c50-9c27-2ecfdd0689c6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:44.387814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cac7dcba-d507-4c50-9c27-2ecfdd0689c6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:44.388392 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cac7dcba-d507-4c50-9c27-2ecfdd0689c6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:44.389164 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cac7dcba-d507-4c50-9c27-2ecfdd0689c6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:44.389602 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cac7dcba-d507-4c50-9c27-2ecfdd0689c6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:44.520547 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-cac7dcba-d507-4c50-9c27-2ecfdd0689c6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:44.528023 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-cac7dcba-d507-4c50-9c27-2ecfdd0689c6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1513 microversion: 2.1 time: 0.151732 Aug 02 08:56:44.528633 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 151/318] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:44 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:45.317671 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-bf8fec6d-a0dd-412c-bc04-0911bceb2f69 req-e337f62b-5e03-494e-a060-787510274ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb4ab28-698c-4f0d-a1a6-932951362ac0", "name": "network-vif-deleted", "tag": "a56ed13f-315a-489b-a828-95c0c7dc7794"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:56:45.328728 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-bf8fec6d-a0dd-412c-bc04-0911bceb2f69 req-e337f62b-5e03-494e-a060-787510274ca2 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:45.329160 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-bf8fec6d-a0dd-412c-bc04-0911bceb2f69 req-e337f62b-5e03-494e-a060-787510274ca2 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:45.341762 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-bf8fec6d-a0dd-412c-bc04-0911bceb2f69 req-e337f62b-5e03-494e-a060-787510274ca2 service nova] Creating event network-vif-deleted:a56ed13f-315a-489b-a828-95c0c7dc7794 for instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 on hv-cinder-78729 Aug 02 08:56:45.346685 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-bf8fec6d-a0dd-412c-bc04-0911bceb2f69 req-e337f62b-5e03-494e-a060-787510274ca2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Aug 02 08:56:45.347281 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 168/319] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:56:45.548504 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:45.549118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:45.555425 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:45.555872 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:45.556683 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:45.557118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:45.731989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:45.732452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:45.732904 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lazy-loading 'fault' on Instance uuid 4eb4ab28-698c-4f0d-a1a6-932951362ac0 {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:56:45.780506 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:45.788070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2ea08156-6cf6-4a3d-aac1-b3742638d157 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 200 len: 1308 microversion: 2.1 time: 0.243289 Aug 02 08:56:45.788654 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 152/320] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:45 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:56:46.810686 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:46.811391 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: 4eb4ab28-698c-4f0d-a1a6-932951362ac0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:46.817677 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:46.818118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:46.818880 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:46.819319 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:46.836594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] HTTP exception thrown: Instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 could not be found. Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Request method failure captured: Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 HTTP/1.1 Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZtLIlmJaHTvcW62nSMYzFxAypjDSf_6PmJnXN1hVzouHCvMLSH5mCzFbBT7tTRmRp7_9j7ty6xLTH6br4OUQunfr-rfVxJe_WedhrmVBzSip5_yz6wxTUko1TywLldGJ3-Xku-68-b64cBKCm3burWnT_Tr4Uz0BU9M1J2I0ENP-k Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: b40df4325f5c495396daab8f57b0dcf4 Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1527635669 Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:56:46.838182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b40df4325f5c495396daab8f57b0dcf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b40df4325f5c495396daab8f57b0dcf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b40df4325f5c495396daab8f57b0dcf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b40df4325f5c495396daab8f57b0dcf4"}]}] Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-VolumesSnapshotTestJSON-1527635669 Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: b40df4325f5c495396daab8f57b0dcf4 Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1527635669 Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-VolumesSnapshotTestJSON-1527635669-project Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 41650f44d6a14a1abab40d3f05317fa8 Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-VolumesSnapshotTestJSON-1527635669-project Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 could not be found. Aug 02 08:56:46.839882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '4eb4ab28-698c-4f0d-a1a6-932951362ac0'} Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 could not be found. Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:56:46.840827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 could not be found. Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 could not be found. Aug 02 08:56:46.842382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:56:46.844085 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Returning 404 to user: Instance 4eb4ab28-698c-4f0d-a1a6-932951362ac0 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:56:46.844085 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b30fdd87-3777-4411-a316-926e43b43847 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0" status: 404 len: 111 microversion: 2.1 time: 0.034105 Aug 02 08:56:46.844085 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 169/321] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:46 2022] GET /compute/v2.1/servers/4eb4ab28-698c-4f0d-a1a6-932951362ac0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 08:56:58.791160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-867891497", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "networks": [{"uuid": "eef0ab1f-9f99-4dbf-a7d7-6a0a7959e7e2"}]}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:56:58.800468 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=10 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:58.801292 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:58.849336 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] validate_networks() for [('eef0ab1f-9f99-4dbf-a7d7-6a0a7959e7e2', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:56:59.183080 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:56:59.183492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:56:59.184105 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:56:59.184534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:56:59.184965 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:56:59.194617 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:59.194963 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:59.195754 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:59.196235 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:59.212549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Getting quotas for project b40df4325f5c495396daab8f57b0dcf4. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:56:59.216663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Getting quotas for user 41650f44d6a14a1abab40d3f05317fa8 and project b40df4325f5c495396daab8f57b0dcf4. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:56:59.227245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:56:59.229484 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:56:59.274381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-27ecb58e-ae0b-480e-95ab-9e77421fc415 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487130 Aug 02 08:56:59.275016 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 153/322] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:56:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:56:59.286176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-864be2b8-a3fa-48ba-9b05-bc5242862b6e tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:59.286878 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-864be2b8-a3fa-48ba-9b05-bc5242862b6e tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:56:59.289543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:59.291622 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:56:59.349513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-864be2b8-a3fa-48ba-9b05-bc5242862b6e tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:56:59.356468 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-864be2b8-a3fa-48ba-9b05-bc5242862b6e tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1218 microversion: 2.1 time: 0.074306 Aug 02 08:56:59.357511 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 170/323] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:56:59 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:00.378780 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5957bd42-90e2-47d5-aa03-6468de6957df tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:00.379538 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5957bd42-90e2-47d5-aa03-6468de6957df tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:00.386638 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5957bd42-90e2-47d5-aa03-6468de6957df tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:00.387166 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5957bd42-90e2-47d5-aa03-6468de6957df tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:00.388063 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5957bd42-90e2-47d5-aa03-6468de6957df tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:00.389255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5957bd42-90e2-47d5-aa03-6468de6957df tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:00.467382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5957bd42-90e2-47d5-aa03-6468de6957df tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:00.474834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5957bd42-90e2-47d5-aa03-6468de6957df tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1288 microversion: 2.1 time: 0.100448 Aug 02 08:57:00.475723 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 154/324] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:00 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:01.495960 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-760526dc-a523-423c-83bc-0735a4f3f489 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:01.496612 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-760526dc-a523-423c-83bc-0735a4f3f489 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:01.504038 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-760526dc-a523-423c-83bc-0735a4f3f489 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:01.504519 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-760526dc-a523-423c-83bc-0735a4f3f489 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:01.505298 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-760526dc-a523-423c-83bc-0735a4f3f489 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:01.505735 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-760526dc-a523-423c-83bc-0735a4f3f489 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:01.619878 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-81960acd-3f1c-4067-9224-f7584a63e296 req-318c9d32-7052-4f09-829a-415e876b6d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c530cc3e-6de6-47a0-bed7-db7b95458538", "tag": "d3b3ecec-da38-4fbb-ab96-707da05ffbba"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:57:01.633506 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-81960acd-3f1c-4067-9224-f7584a63e296 req-318c9d32-7052-4f09-829a-415e876b6d49 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:01.634044 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-81960acd-3f1c-4067-9224-f7584a63e296 req-318c9d32-7052-4f09-829a-415e876b6d49 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:01.641091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-760526dc-a523-423c-83bc-0735a4f3f489 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:01.648619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-760526dc-a523-423c-83bc-0735a4f3f489 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.156430 Aug 02 08:57:01.649197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 171/325] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:01 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:57:01.653897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-81960acd-3f1c-4067-9224-f7584a63e296 req-318c9d32-7052-4f09-829a-415e876b6d49 service nova] Creating event network-changed:d3b3ecec-da38-4fbb-ab96-707da05ffbba for instance c530cc3e-6de6-47a0-bed7-db7b95458538 on hv-cinder-78729 Aug 02 08:57:01.659596 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-81960acd-3f1c-4067-9224-f7584a63e296 req-318c9d32-7052-4f09-829a-415e876b6d49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043909 Aug 02 08:57:01.660211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 155/326] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:57:02.671517 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f8144c2b-eb87-4c50-bccf-e01b6194b899 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:02.672027 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f8144c2b-eb87-4c50-bccf-e01b6194b899 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:02.678555 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f8144c2b-eb87-4c50-bccf-e01b6194b899 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:02.679532 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f8144c2b-eb87-4c50-bccf-e01b6194b899 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:02.680329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f8144c2b-eb87-4c50-bccf-e01b6194b899 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:02.680768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f8144c2b-eb87-4c50-bccf-e01b6194b899 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:03.022943 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f8144c2b-eb87-4c50-bccf-e01b6194b899 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:03.030842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f8144c2b-eb87-4c50-bccf-e01b6194b899 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.363967 Aug 02 08:57:03.031389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 172/327] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:02 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:57:04.051858 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20c176a9-af20-4617-88ca-ced79a118338 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:04.052597 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-20c176a9-af20-4617-88ca-ced79a118338 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:04.059539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20c176a9-af20-4617-88ca-ced79a118338 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:04.059940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20c176a9-af20-4617-88ca-ced79a118338 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:04.060885 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20c176a9-af20-4617-88ca-ced79a118338 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:04.061352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20c176a9-af20-4617-88ca-ced79a118338 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:04.188082 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20c176a9-af20-4617-88ca-ced79a118338 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:04.195454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-20c176a9-af20-4617-88ca-ced79a118338 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.147856 Aug 02 08:57:04.196246 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 156/328] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:04 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:05.216212 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f1515ec9-6285-4b62-b084-210ec9c72348 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:05.216869 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f1515ec9-6285-4b62-b084-210ec9c72348 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:05.223362 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f1515ec9-6285-4b62-b084-210ec9c72348 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:05.223816 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f1515ec9-6285-4b62-b084-210ec9c72348 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:05.224623 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f1515ec9-6285-4b62-b084-210ec9c72348 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:05.225068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f1515ec9-6285-4b62-b084-210ec9c72348 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:05.351119 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f1515ec9-6285-4b62-b084-210ec9c72348 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:05.359033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f1515ec9-6285-4b62-b084-210ec9c72348 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.146820 Aug 02 08:57:05.359598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 173/329] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:05 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:06.379600 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7a365427-01e1-4cc2-b219-e013c1e41df5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:06.380251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7a365427-01e1-4cc2-b219-e013c1e41df5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:06.386556 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7a365427-01e1-4cc2-b219-e013c1e41df5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:06.386998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7a365427-01e1-4cc2-b219-e013c1e41df5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:06.387760 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7a365427-01e1-4cc2-b219-e013c1e41df5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:06.388865 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7a365427-01e1-4cc2-b219-e013c1e41df5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:06.519110 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7a365427-01e1-4cc2-b219-e013c1e41df5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:06.526609 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7a365427-01e1-4cc2-b219-e013c1e41df5 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.150903 Aug 02 08:57:06.527171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 157/330] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:06 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:07.546783 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1aad4f70-91e8-4460-8894-644600a6495b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:07.547393 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1aad4f70-91e8-4460-8894-644600a6495b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:07.553958 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1aad4f70-91e8-4460-8894-644600a6495b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:07.554406 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1aad4f70-91e8-4460-8894-644600a6495b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:07.555173 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1aad4f70-91e8-4460-8894-644600a6495b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:07.555611 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1aad4f70-91e8-4460-8894-644600a6495b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:07.684911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1aad4f70-91e8-4460-8894-644600a6495b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:07.692791 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1aad4f70-91e8-4460-8894-644600a6495b tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.149855 Aug 02 08:57:07.693354 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 174/331] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:07 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:08.714180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-edcc1286-94b1-4ba7-bea9-792d6ebe1745 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:08.714787 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-edcc1286-94b1-4ba7-bea9-792d6ebe1745 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:08.721801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-edcc1286-94b1-4ba7-bea9-792d6ebe1745 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:08.722244 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-edcc1286-94b1-4ba7-bea9-792d6ebe1745 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:08.723030 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-edcc1286-94b1-4ba7-bea9-792d6ebe1745 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:08.723454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-edcc1286-94b1-4ba7-bea9-792d6ebe1745 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:08.852788 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-edcc1286-94b1-4ba7-bea9-792d6ebe1745 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:08.860145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-edcc1286-94b1-4ba7-bea9-792d6ebe1745 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.149767 Aug 02 08:57:08.860695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 158/332] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:08 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:08.914838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:57:08.915384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Tue Aug 2 08:57:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:57:09.201589 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-993a0dcf-5308-4c4a-b2dd-f366bcee999d req-563a4c7e-330a-4ad5-b914-d489c683737c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c530cc3e-6de6-47a0-bed7-db7b95458538", "name": "network-vif-plugged", "status": "completed", "tag": "d3b3ecec-da38-4fbb-ab96-707da05ffbba"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:57:09.212907 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-993a0dcf-5308-4c4a-b2dd-f366bcee999d req-563a4c7e-330a-4ad5-b914-d489c683737c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:09.213359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-993a0dcf-5308-4c4a-b2dd-f366bcee999d req-563a4c7e-330a-4ad5-b914-d489c683737c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:09.223728 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-993a0dcf-5308-4c4a-b2dd-f366bcee999d req-563a4c7e-330a-4ad5-b914-d489c683737c service nova] Creating event network-vif-plugged:d3b3ecec-da38-4fbb-ab96-707da05ffbba for instance c530cc3e-6de6-47a0-bed7-db7b95458538 on hv-cinder-78729 Aug 02 08:57:09.228616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-993a0dcf-5308-4c4a-b2dd-f366bcee999d req-563a4c7e-330a-4ad5-b914-d489c683737c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032218 Aug 02 08:57:09.229352 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 175/333] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:57:09.880957 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3336aced-b71f-4f90-b1db-a028804ad787 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:09.881603 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3336aced-b71f-4f90-b1db-a028804ad787 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:09.883571 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:09.884255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=6 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:09.890926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3336aced-b71f-4f90-b1db-a028804ad787 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:09.891381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3336aced-b71f-4f90-b1db-a028804ad787 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:09.892180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3336aced-b71f-4f90-b1db-a028804ad787 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:09.892634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3336aced-b71f-4f90-b1db-a028804ad787 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:10.029447 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3336aced-b71f-4f90-b1db-a028804ad787 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:10.036904 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3336aced-b71f-4f90-b1db-a028804ad787 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.159810 Aug 02 08:57:10.037474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 159/334] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:09 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:11.055243 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:11.059893 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6d5d5b53-9802-47dc-892c-0a74373b2a8a tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:11.061262 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6d5d5b53-9802-47dc-892c-0a74373b2a8a tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:11.067938 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6d5d5b53-9802-47dc-892c-0a74373b2a8a tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:11.068418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6d5d5b53-9802-47dc-892c-0a74373b2a8a tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:11.069191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6d5d5b53-9802-47dc-892c-0a74373b2a8a tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:11.069634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6d5d5b53-9802-47dc-892c-0a74373b2a8a tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:11.194551 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6d5d5b53-9802-47dc-892c-0a74373b2a8a tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:11.202000 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6d5d5b53-9802-47dc-892c-0a74373b2a8a tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1318 microversion: 2.1 time: 0.147846 Aug 02 08:57:11.202569 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 176/335] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:11 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:12.223194 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7a148a4d-ff03-4031-a36b-a54e0d0a6237 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:12.223735 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7a148a4d-ff03-4031-a36b-a54e0d0a6237 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:12.229916 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7a148a4d-ff03-4031-a36b-a54e0d0a6237 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:12.230393 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7a148a4d-ff03-4031-a36b-a54e0d0a6237 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:12.231136 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7a148a4d-ff03-4031-a36b-a54e0d0a6237 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:12.231566 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7a148a4d-ff03-4031-a36b-a54e0d0a6237 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:12.370128 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7a148a4d-ff03-4031-a36b-a54e0d0a6237 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:12.378112 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7a148a4d-ff03-4031-a36b-a54e0d0a6237 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1507 microversion: 2.1 time: 0.159086 Aug 02 08:57:12.378675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 160/336] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:12 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:12.399993 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5e0a21e9-646a-461c-a9ec-57f5805af5d6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acaa56f7-c112-4ac6-8288-7f8b0042101d", "device": "/dev/sdb"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:57:12.402839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5e0a21e9-646a-461c-a9ec-57f5805af5d6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:12.409371 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e0a21e9-646a-461c-a9ec-57f5805af5d6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:12.409822 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e0a21e9-646a-461c-a9ec-57f5805af5d6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:12.410622 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e0a21e9-646a-461c-a9ec-57f5805af5d6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:12.411055 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e0a21e9-646a-461c-a9ec-57f5805af5d6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:12.874391 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5e0a21e9-646a-461c-a9ec-57f5805af5d6 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "POST /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478126 Aug 02 08:57:12.875020 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 177/337] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 08:57:12 2022] POST /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:57:28.185827 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e16fbf82-8912-4ee9-bb5b-638ab8dc92ac tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:28.186447 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e16fbf82-8912-4ee9-bb5b-638ab8dc92ac tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:28.188893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:28.189544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=40 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:28.195389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e16fbf82-8912-4ee9-bb5b-638ab8dc92ac tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:28.195840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e16fbf82-8912-4ee9-bb5b-638ab8dc92ac tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:28.196640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e16fbf82-8912-4ee9-bb5b-638ab8dc92ac tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:28.197081 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e16fbf82-8912-4ee9-bb5b-638ab8dc92ac tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:28.222218 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e16fbf82-8912-4ee9-bb5b-638ab8dc92ac tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/ips" status: 200 len: 152 microversion: 2.20 time: 0.040342 Aug 02 08:57:28.222784 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 161/338] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Aug 2 08:57:28 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:57:30.499080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=18 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:30.499854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:30.504170 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e616f452-9b1d-4654-8c1c-7d2b7fcd0b0d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:30.504751 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e616f452-9b1d-4654-8c1c-7d2b7fcd0b0d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:30.512642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e616f452-9b1d-4654-8c1c-7d2b7fcd0b0d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:30.513093 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e616f452-9b1d-4654-8c1c-7d2b7fcd0b0d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:30.513865 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e616f452-9b1d-4654-8c1c-7d2b7fcd0b0d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:30.514948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e616f452-9b1d-4654-8c1c-7d2b7fcd0b0d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:30.537882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e616f452-9b1d-4654-8c1c-7d2b7fcd0b0d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/ips" status: 200 len: 146 microversion: 2.1 time: 0.040842 Aug 02 08:57:30.538439 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 178/339] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 08:57:30 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:57:35.559658 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-31bceb3d-47fc-42e3-9932-4230128776a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:57:35.560223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-31bceb3d-47fc-42e3-9932-4230128776a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:35.567327 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-31bceb3d-47fc-42e3-9932-4230128776a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:35.567783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-31bceb3d-47fc-42e3-9932-4230128776a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:35.568592 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-31bceb3d-47fc-42e3-9932-4230128776a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:35.569021 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-31bceb3d-47fc-42e3-9932-4230128776a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:35.592004 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-31bceb3d-47fc-42e3-9932-4230128776a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lazy-loading 'flavor' on Instance uuid b1f9c72f-350b-428c-b020-d16159e0c991 {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:57:35.656992 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3422f4ad-15d0-421a-95dd-4292c8ce4fe9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd156143-c219-4b60-9ce7-2bea47d6abe2"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:57:35.659359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3422f4ad-15d0-421a-95dd-4292c8ce4fe9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:35.665779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3422f4ad-15d0-421a-95dd-4292c8ce4fe9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:35.666577 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3422f4ad-15d0-421a-95dd-4292c8ce4fe9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:35.666971 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3422f4ad-15d0-421a-95dd-4292c8ce4fe9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:35.667400 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3422f4ad-15d0-421a-95dd-4292c8ce4fe9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:35.800232 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-31bceb3d-47fc-42e3-9932-4230128776a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/action" status: 202 len: 0 microversion: 2.20 time: 0.244293 Aug 02 08:57:35.800834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 162/340] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 2 08:57:35 2022] POST /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:57:35.809741 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:35.810371 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:35.818166 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:35.818616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:35.819392 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:35.819831 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:35.964664 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:35.972658 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:35.974171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:35.975331 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-57aa252d-d033-4ba7-b303-0fc2dc3d8121 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.170028 Aug 02 08:57:35.975914 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 163/341] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:35 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:57:35.994510 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3422f4ad-15d0-421a-95dd-4292c8ce4fe9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342110 Aug 02 08:57:35.995115 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 179/342] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 08:57:35 2022] POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:57:37.002160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:37.003050 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:37.009849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:37.010296 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:37.011052 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:37.011520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:37.143377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:37.151250 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:37.152805 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:37.153950 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-01306a12-1227-4d26-9957-6bff82a0744c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.156651 Aug 02 08:57:37.154505 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 164/343] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:36 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:38.179564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:38.180296 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:38.186581 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:38.187029 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:38.187791 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:38.188746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:38.321501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:38.330203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:38.331705 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:38.333130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1ef296b4-7aa0-4630-bc46-68b3952c7b76 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.158242 Aug 02 08:57:38.333682 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 180/344] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:38 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:38.418364 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fbfd884b-7393-40e3-82f5-9a60b5c43b7f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:38.418857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fbfd884b-7393-40e3-82f5-9a60b5c43b7f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:38.425342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fbfd884b-7393-40e3-82f5-9a60b5c43b7f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:38.425785 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fbfd884b-7393-40e3-82f5-9a60b5c43b7f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:38.426544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fbfd884b-7393-40e3-82f5-9a60b5c43b7f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:38.427012 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fbfd884b-7393-40e3-82f5-9a60b5c43b7f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:38.504924 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-fbfd884b-7393-40e3-82f5-9a60b5c43b7f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lazy-loading 'services' on Instance uuid c530cc3e-6de6-47a0-bed7-db7b95458538 {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:57:38.580657 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fbfd884b-7393-40e3-82f5-9a60b5c43b7f tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538/os-volume_attachments/acaa56f7-c112-4ac6-8288-7f8b0042101d" status: 202 len: 0 microversion: 2.1 time: 0.165983 Aug 02 08:57:38.581263 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 165/345] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 08:57:38 2022] DELETE /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538/os-volume_attachments/acaa56f7-c112-4ac6-8288-7f8b0042101d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:57:39.356610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:39.357213 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:39.364371 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:39.364817 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:39.365589 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:39.366019 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:39.494914 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:39.503016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:39.504577 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:39.505754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-06ba2856-7aed-48db-9a84-c6fa8a7d673e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.153114 Aug 02 08:57:39.506303 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 181/346] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:39 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:40.528806 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:40.529429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:40.536210 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:40.536664 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:40.537433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:40.537869 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:40.688566 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:40.696442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:40.697959 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:40.699108 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ed807619-5e66-484d-a5df-60922e534036 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.175194 Aug 02 08:57:40.699675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 166/347] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:40 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:41.723461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:41.724087 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:41.730897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:41.731342 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:41.732108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:41.732573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:41.876382 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:41.881815 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:41.883299 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:41.884511 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b808e823-3b24-4e14-8416-f42c8b5d9ab6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.165454 Aug 02 08:57:41.885056 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 182/348] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:41 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:42.907324 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:42.907956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:42.914434 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:42.914886 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:42.915650 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:42.916087 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:43.045737 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:43.054156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:43.055726 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:43.056856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-709dc01b-08ee-4266-8193-081f3cf6b940 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.154077 Aug 02 08:57:43.057452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 167/349] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:42 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:44.080757 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:44.082531 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:44.088952 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:44.089405 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:44.090179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:44.090620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:44.224529 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:44.232418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:44.233930 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:44.235081 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d3c32169-08bb-4f33-a001-7001a34e2d2f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.158826 Aug 02 08:57:44.235878 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 183/350] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:44 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:44.566360 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ed21eb37-f18b-47e3-bdd8-8bf5048d02ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:57:44.572784 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed21eb37-f18b-47e3-bdd8-8bf5048d02ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:44.573227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed21eb37-f18b-47e3-bdd8-8bf5048d02ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:44.634510 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ed21eb37-f18b-47e3-bdd8-8bf5048d02ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Going to try to stop instance {{(pid=117772) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 08:57:44.676257 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ed21eb37-f18b-47e3-bdd8-8bf5048d02ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/action" status: 202 len: 0 microversion: 2.1 time: 0.114159 Aug 02 08:57:44.676843 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 168/351] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 08:57:44 2022] POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:57:44.685995 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fdae207b-51f2-494f-8268-f634c48220a2 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:44.686610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fdae207b-51f2-494f-8268-f634c48220a2 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:44.693272 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fdae207b-51f2-494f-8268-f634c48220a2 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:44.693724 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fdae207b-51f2-494f-8268-f634c48220a2 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:44.694494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fdae207b-51f2-494f-8268-f634c48220a2 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:44.695012 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fdae207b-51f2-494f-8268-f634c48220a2 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:44.826250 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fdae207b-51f2-494f-8268-f634c48220a2 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:44.834467 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fdae207b-51f2-494f-8268-f634c48220a2 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.152520 Aug 02 08:57:44.835022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 184/352] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:44 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:45.258621 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:45.259466 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:45.267285 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:45.267739 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:45.268555 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:45.268997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:45.401621 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:45.410237 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:45.411752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:45.412941 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5c331b8d-6805-4448-9203-65fd8ae816c4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.158689 Aug 02 08:57:45.413497 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 169/353] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:45 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:45.856080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-74c0c477-951a-403c-b73d-4acbb7dc0d3e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:45.856655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-74c0c477-951a-403c-b73d-4acbb7dc0d3e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:45.863188 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74c0c477-951a-403c-b73d-4acbb7dc0d3e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:45.863642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74c0c477-951a-403c-b73d-4acbb7dc0d3e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:45.864445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74c0c477-951a-403c-b73d-4acbb7dc0d3e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:45.864887 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74c0c477-951a-403c-b73d-4acbb7dc0d3e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:45.996901 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-74c0c477-951a-403c-b73d-4acbb7dc0d3e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:46.004846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-74c0c477-951a-403c-b73d-4acbb7dc0d3e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.152726 Aug 02 08:57:46.005593 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 185/354] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:45 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:46.042376 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-bc1b82d4-77be-41a0-8111-d617e19f9d35 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:46.042879 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-bc1b82d4-77be-41a0-8111-d617e19f9d35 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:46.049550 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bc1b82d4-77be-41a0-8111-d617e19f9d35 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:46.050003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bc1b82d4-77be-41a0-8111-d617e19f9d35 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:46.050768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bc1b82d4-77be-41a0-8111-d617e19f9d35 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:46.051208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bc1b82d4-77be-41a0-8111-d617e19f9d35 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:46.078335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-bc1b82d4-77be-41a0-8111-d617e19f9d35 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:57:46.154630 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-bc1b82d4-77be-41a0-8111-d617e19f9d35 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 204 len: 0 microversion: 2.1 time: 0.115463 Aug 02 08:57:46.156409 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 170/355] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 08:57:46 2022] DELETE /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:57:46.165314 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-63ee6b31-a97b-4938-98b9-c0d5990c5dea tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:46.165932 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-63ee6b31-a97b-4938-98b9-c0d5990c5dea tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:46.171831 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-63ee6b31-a97b-4938-98b9-c0d5990c5dea tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:46.172321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-63ee6b31-a97b-4938-98b9-c0d5990c5dea tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:46.173084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-63ee6b31-a97b-4938-98b9-c0d5990c5dea tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:46.173521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-63ee6b31-a97b-4938-98b9-c0d5990c5dea tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:46.302036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-63ee6b31-a97b-4938-98b9-c0d5990c5dea tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:46.309454 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-63ee6b31-a97b-4938-98b9-c0d5990c5dea tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1513 microversion: 2.1 time: 0.148737 Aug 02 08:57:46.310054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 186/356] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:46 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:46.439458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:46.440086 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:46.446118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:46.446567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:46.447345 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:46.447769 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:46.581213 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:46.589409 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:46.590904 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:46.592043 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3ce7cec4-f95c-4d86-98a5-e3b0517fa7ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.158028 Aug 02 08:57:46.592717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 171/357] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:46 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:47.026435 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a4831880-31c3-4f72-acba-592fbbd3f0de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:47.027054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a4831880-31c3-4f72-acba-592fbbd3f0de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:47.033920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4831880-31c3-4f72-acba-592fbbd3f0de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:47.034363 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4831880-31c3-4f72-acba-592fbbd3f0de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:47.035114 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4831880-31c3-4f72-acba-592fbbd3f0de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:47.035545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4831880-31c3-4f72-acba-592fbbd3f0de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:47.161551 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a4831880-31c3-4f72-acba-592fbbd3f0de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:47.169444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a4831880-31c3-4f72-acba-592fbbd3f0de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.146857 Aug 02 08:57:47.170000 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 187/358] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:47 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:47.331370 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ee55b6e9-f8dc-47ae-a5ed-85d32d3c6a68 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:47.332002 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ee55b6e9-f8dc-47ae-a5ed-85d32d3c6a68 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:47.338774 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ee55b6e9-f8dc-47ae-a5ed-85d32d3c6a68 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:47.339227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ee55b6e9-f8dc-47ae-a5ed-85d32d3c6a68 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:47.339986 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ee55b6e9-f8dc-47ae-a5ed-85d32d3c6a68 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:47.340457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ee55b6e9-f8dc-47ae-a5ed-85d32d3c6a68 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:47.358460 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:47.474928 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ee55b6e9-f8dc-47ae-a5ed-85d32d3c6a68 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:47.482386 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ee55b6e9-f8dc-47ae-a5ed-85d32d3c6a68 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1513 microversion: 2.1 time: 0.155473 Aug 02 08:57:47.482952 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 172/359] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:47 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:47.614730 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:47.615344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:47.621455 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:47.621907 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:47.622673 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:47.623110 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:47.753342 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:47.761226 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:47.762721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:47.763865 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-65d933c0-7e92-47a7-a1f1-3360753d5164 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.153032 Aug 02 08:57:47.764478 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 188/360] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:47 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:48.191497 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-71a382a9-7533-41e7-a42d-2058f62ddde5 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:48.192154 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-71a382a9-7533-41e7-a42d-2058f62ddde5 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:48.198109 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-71a382a9-7533-41e7-a42d-2058f62ddde5 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:48.198558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-71a382a9-7533-41e7-a42d-2058f62ddde5 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:48.199315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-71a382a9-7533-41e7-a42d-2058f62ddde5 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:48.199748 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-71a382a9-7533-41e7-a42d-2058f62ddde5 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:48.343271 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-71a382a9-7533-41e7-a42d-2058f62ddde5 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:48.351190 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-71a382a9-7533-41e7-a42d-2058f62ddde5 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.164131 Aug 02 08:57:48.351745 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 173/361] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:48 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:48.502927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fc78671d-263e-4970-b4c0-84bf85b620cc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:48.503467 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fc78671d-263e-4970-b4c0-84bf85b620cc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:48.510106 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fc78671d-263e-4970-b4c0-84bf85b620cc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:48.510559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fc78671d-263e-4970-b4c0-84bf85b620cc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:48.511328 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fc78671d-263e-4970-b4c0-84bf85b620cc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:48.511768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fc78671d-263e-4970-b4c0-84bf85b620cc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:48.655130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fc78671d-263e-4970-b4c0-84bf85b620cc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:48.664807 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fc78671d-263e-4970-b4c0-84bf85b620cc tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1513 microversion: 2.1 time: 0.165751 Aug 02 08:57:48.665691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 189/362] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:48 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:48.788077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:48.788624 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:48.794822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:48.795272 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:48.796043 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:48.796503 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:49.012665 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:49.021208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:49.022702 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:49.023853 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f264c5c0-acdf-47f7-bd04-9e2403fcb45a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.239955 Aug 02 08:57:49.024443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 174/363] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:48 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:49.337420 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-22e6caab-d0cf-4d0c-ad79-de927572b0a2 req-8f3daf24-c2cf-43d1-8857-22b343944797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c530cc3e-6de6-47a0-bed7-db7b95458538", "name": "network-vif-deleted", "tag": "d3b3ecec-da38-4fbb-ab96-707da05ffbba"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:57:49.347212 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-22e6caab-d0cf-4d0c-ad79-de927572b0a2 req-8f3daf24-c2cf-43d1-8857-22b343944797 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:49.347654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-22e6caab-d0cf-4d0c-ad79-de927572b0a2 req-8f3daf24-c2cf-43d1-8857-22b343944797 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:49.358498 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-22e6caab-d0cf-4d0c-ad79-de927572b0a2 req-8f3daf24-c2cf-43d1-8857-22b343944797 service nova] Creating event network-vif-deleted:d3b3ecec-da38-4fbb-ab96-707da05ffbba for instance c530cc3e-6de6-47a0-bed7-db7b95458538 on hv-cinder-78729 Aug 02 08:57:49.363340 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-22e6caab-d0cf-4d0c-ad79-de927572b0a2 req-8f3daf24-c2cf-43d1-8857-22b343944797 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029580 Aug 02 08:57:49.363861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 190/364] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:57:49.372703 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e86f69aa-759a-4a4f-b7af-7cc097c376ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:49.373358 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e86f69aa-759a-4a4f-b7af-7cc097c376ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:49.379955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e86f69aa-759a-4a4f-b7af-7cc097c376ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:49.380437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e86f69aa-759a-4a4f-b7af-7cc097c376ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:49.381205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e86f69aa-759a-4a4f-b7af-7cc097c376ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:49.381636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e86f69aa-759a-4a4f-b7af-7cc097c376ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:49.520335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e86f69aa-759a-4a4f-b7af-7cc097c376ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:49.528376 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e86f69aa-759a-4a4f-b7af-7cc097c376ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.159439 Aug 02 08:57:49.528940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 175/365] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:49 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:49.687427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:49.688050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:49.694796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:49.695241 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:49.696025 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:49.696485 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:49.727740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:49.728228 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:49.728681 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lazy-loading 'fault' on Instance uuid c530cc3e-6de6-47a0-bed7-db7b95458538 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:57:49.776880 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41650f44d6a14a1abab40d3f05317fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40df4325f5c495396daab8f57b0dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:49.784275 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c575795b-dac1-4c65-85e0-97b8312a4754 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 200 len: 1308 microversion: 2.1 time: 0.101568 Aug 02 08:57:49.784829 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 191/366] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:49 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:50.048338 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:50.048948 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:50.054895 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:50.055346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:50.056096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:50.056561 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:50.188612 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:50.196337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:50.197817 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:50.198946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c9d80224-f734-4a32-b776-3a1599f1c2f9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.155225 Aug 02 08:57:50.199499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 176/367] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:50 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:50.549414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-60426f56-4778-410e-9e12-bf0eecb36995 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:50.550030 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-60426f56-4778-410e-9e12-bf0eecb36995 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:50.556033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60426f56-4778-410e-9e12-bf0eecb36995 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:50.556513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60426f56-4778-410e-9e12-bf0eecb36995 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:50.557275 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60426f56-4778-410e-9e12-bf0eecb36995 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:50.557756 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60426f56-4778-410e-9e12-bf0eecb36995 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:50.685054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-60426f56-4778-410e-9e12-bf0eecb36995 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:50.694001 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-60426f56-4778-410e-9e12-bf0eecb36995 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.148474 Aug 02 08:57:50.694599 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 192/368] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:50 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:50.805943 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:50.806578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] [instance: c530cc3e-6de6-47a0-bed7-db7b95458538] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:50.813692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:50.814144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:50.814914 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:50.815351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:50.828762 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] HTTP exception thrown: Instance c530cc3e-6de6-47a0-bed7-db7b95458538 could not be found. Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Request method failure captured: Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 HTTP/1.1 Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OZtLIlmJaHTvcW62nSMYzFxAypjDSf_6PmJnXN1hVzouHCvMLSH5mCzFbBT7tTRmRp7_9j7ty6xLTH6br4OUQunfr-rfVxJe_WedhrmVBzSip5_yz6wxTUko1TywLldGJ3-Xku-68-b64cBKCm3burWnT_Tr4Uz0BU9M1J2I0ENP-k Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: b40df4325f5c495396daab8f57b0dcf4 Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1527635669 Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 08:57:50.831025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b40df4325f5c495396daab8f57b0dcf4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b40df4325f5c495396daab8f57b0dcf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b40df4325f5c495396daab8f57b0dcf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b40df4325f5c495396daab8f57b0dcf4"}]}] Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-VolumesSnapshotTestJSON-1527635669 Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: b40df4325f5c495396daab8f57b0dcf4 Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1527635669 Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-VolumesSnapshotTestJSON-1527635669-project Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 41650f44d6a14a1abab40d3f05317fa8 Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-VolumesSnapshotTestJSON-1527635669-project Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance c530cc3e-6de6-47a0-bed7-db7b95458538 could not be found. Aug 02 08:57:50.832949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'c530cc3e-6de6-47a0-bed7-db7b95458538'} Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c530cc3e-6de6-47a0-bed7-db7b95458538 could not be found. Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:57:50.833747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c530cc3e-6de6-47a0-bed7-db7b95458538 could not be found. Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c530cc3e-6de6-47a0-bed7-db7b95458538 could not be found. Aug 02 08:57:50.834954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 08:57:50.836077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] Returning 404 to user: Instance c530cc3e-6de6-47a0-bed7-db7b95458538 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:57:50.836077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6f58139e-7ec7-4541-9d67-97a9f4c3a9d1 tempest-VolumesSnapshotTestJSON-1527635669 tempest-VolumesSnapshotTestJSON-1527635669-project] 10.222.0.17 "GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538" status: 404 len: 111 microversion: 2.1 time: 0.030259 Aug 02 08:57:50.836077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 177/369] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:50 2022] GET /compute/v2.1/servers/c530cc3e-6de6-47a0-bed7-db7b95458538 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:57:51.223164 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:51.223819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:51.230083 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:51.230524 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:51.231283 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:51.231718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:51.363563 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:51.367063 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:51.372299 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:51.373788 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:51.374929 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-28149bc2-dda2-478f-8f49-4b28732bf7a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.156354 Aug 02 08:57:51.375479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 193/370] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:51 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:51.716090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-181364e3-6322-4efe-bdd0-ec58f64ce445 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:51.716689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-181364e3-6322-4efe-bdd0-ec58f64ce445 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:51.722802 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-181364e3-6322-4efe-bdd0-ec58f64ce445 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:51.723249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-181364e3-6322-4efe-bdd0-ec58f64ce445 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:51.724004 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-181364e3-6322-4efe-bdd0-ec58f64ce445 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:51.724462 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-181364e3-6322-4efe-bdd0-ec58f64ce445 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:51.852533 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-181364e3-6322-4efe-bdd0-ec58f64ce445 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:51.860993 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-181364e3-6322-4efe-bdd0-ec58f64ce445 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.148268 Aug 02 08:57:51.861580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 178/371] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:51 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:52.398618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:52.399160 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:52.406939 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:52.408109 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:52.408910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:52.409345 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:52.540424 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:52.549006 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:52.550522 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:52.551671 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-21f91ee4-f644-4ec6-a371-93d3e6137f58 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.157796 Aug 02 08:57:52.552248 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 194/372] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:52 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:52.882246 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-40ab6aea-14e0-4153-90ae-bb1402dfb8ea tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:52.882856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-40ab6aea-14e0-4153-90ae-bb1402dfb8ea tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:52.889351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-40ab6aea-14e0-4153-90ae-bb1402dfb8ea tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:52.889799 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-40ab6aea-14e0-4153-90ae-bb1402dfb8ea tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:52.890562 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-40ab6aea-14e0-4153-90ae-bb1402dfb8ea tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:52.891000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-40ab6aea-14e0-4153-90ae-bb1402dfb8ea tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:53.023154 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-40ab6aea-14e0-4153-90ae-bb1402dfb8ea tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:53.031114 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-40ab6aea-14e0-4153-90ae-bb1402dfb8ea tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.152738 Aug 02 08:57:53.031672 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 179/373] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:52 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:53.574521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:53.575123 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:53.582100 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:53.582803 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:53.583556 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:53.583990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:53.712036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:53.720522 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:53.722013 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:53.723154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8c5e49e5-d63b-444c-bbfa-0409eaf91f6e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.152574 Aug 02 08:57:53.723857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 195/374] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:53 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:54.052250 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a2075bc3-f7b4-4df3-9e50-bb4fdf4c61de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:54.052917 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a2075bc3-f7b4-4df3-9e50-bb4fdf4c61de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:54.059612 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a2075bc3-f7b4-4df3-9e50-bb4fdf4c61de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:54.060055 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a2075bc3-f7b4-4df3-9e50-bb4fdf4c61de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:54.060840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a2075bc3-f7b4-4df3-9e50-bb4fdf4c61de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:54.061270 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a2075bc3-f7b4-4df3-9e50-bb4fdf4c61de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:54.187071 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a2075bc3-f7b4-4df3-9e50-bb4fdf4c61de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:54.195069 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a2075bc3-f7b4-4df3-9e50-bb4fdf4c61de tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.147320 Aug 02 08:57:54.195640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 180/375] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:54 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:54.746528 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:54.747047 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:54.753647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:54.754098 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:54.754866 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:54.755305 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:54.885211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:54.893500 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:54.894989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:54.896138 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9b3ac224-d68f-42a2-bcab-58ee012b3594 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.153611 Aug 02 08:57:54.896803 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 196/376] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:54 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:55.217134 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e13a006b-6dd7-49be-bd0d-f68ac57155ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:55.217737 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e13a006b-6dd7-49be-bd0d-f68ac57155ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:55.224222 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e13a006b-6dd7-49be-bd0d-f68ac57155ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:55.224666 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e13a006b-6dd7-49be-bd0d-f68ac57155ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:55.225421 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e13a006b-6dd7-49be-bd0d-f68ac57155ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:55.225855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e13a006b-6dd7-49be-bd0d-f68ac57155ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:55.356528 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e13a006b-6dd7-49be-bd0d-f68ac57155ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:55.364479 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e13a006b-6dd7-49be-bd0d-f68ac57155ab tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.151166 Aug 02 08:57:55.365053 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 181/377] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:55 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:55.919587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:55.920219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:55.927316 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:55.927763 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:55.928561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:55.928999 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:56.057214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:56.065150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:56.066634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:56.067778 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-85591e12-3e68-449a-bdd2-c29c8071b6e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.152072 Aug 02 08:57:56.068359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 197/378] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:55 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:56.386442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a4504935-ad2e-4e98-ad7a-5140d3566f27 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:56.386972 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a4504935-ad2e-4e98-ad7a-5140d3566f27 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:56.393977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a4504935-ad2e-4e98-ad7a-5140d3566f27 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:56.394423 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a4504935-ad2e-4e98-ad7a-5140d3566f27 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:56.395185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a4504935-ad2e-4e98-ad7a-5140d3566f27 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:56.395621 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a4504935-ad2e-4e98-ad7a-5140d3566f27 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:56.526034 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a4504935-ad2e-4e98-ad7a-5140d3566f27 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:56.534756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a4504935-ad2e-4e98-ad7a-5140d3566f27 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.152510 Aug 02 08:57:56.535313 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 182/379] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:56 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:57.090949 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:57.091468 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:57.098542 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:57.099018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:57.099784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:57.100257 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:57.225862 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:57.233786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:57.235276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:57.236447 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-29b91a28-c091-4490-9f8f-52843f85f885 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.149415 Aug 02 08:57:57.236987 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 198/380] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:57 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:57.556240 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-59fdd261-ab65-4bb4-807c-2486b420fa91 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:57.556849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-59fdd261-ab65-4bb4-807c-2486b420fa91 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:57.564915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-59fdd261-ab65-4bb4-807c-2486b420fa91 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:57.565354 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-59fdd261-ab65-4bb4-807c-2486b420fa91 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:57.566115 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-59fdd261-ab65-4bb4-807c-2486b420fa91 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:57.566545 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-59fdd261-ab65-4bb4-807c-2486b420fa91 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:57.708096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-59fdd261-ab65-4bb4-807c-2486b420fa91 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:57.717231 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-59fdd261-ab65-4bb4-807c-2486b420fa91 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.164777 Aug 02 08:57:57.717813 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 183/381] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:57 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:57:58.258931 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:58.259538 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:58.266134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:58.266633 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:58.267515 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:58.268450 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:58.403075 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:58.411124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:58.412690 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:58.413839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fdb2a744-7776-448a-b5d7-34383676c044 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.158894 Aug 02 08:57:58.414394 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 199/382] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:58 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:58.739510 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-85b8ca5d-896d-462b-8caf-653fcf289957 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:58.740148 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-85b8ca5d-896d-462b-8caf-653fcf289957 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:58.743371 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:57:58.749168 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-85b8ca5d-896d-462b-8caf-653fcf289957 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:58.749630 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-85b8ca5d-896d-462b-8caf-653fcf289957 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:58.750370 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-85b8ca5d-896d-462b-8caf-653fcf289957 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:58.750881 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-85b8ca5d-896d-462b-8caf-653fcf289957 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:58.902281 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-85b8ca5d-896d-462b-8caf-653fcf289957 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:58.911171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-85b8ca5d-896d-462b-8caf-653fcf289957 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.176056 Aug 02 08:57:58.911736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 184/383] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:58 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:57:59.436581 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:59.437195 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:59.443734 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:59.444228 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:59.445003 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:59.445444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:59.572096 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:59.581117 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:59.582875 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:57:59.584010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c8cc6440-b787-44d5-bc31-d9d28ab849f0 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.151505 Aug 02 08:57:59.584591 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 200/384] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:57:59 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:57:59.932539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7fc82891-3352-48e8-9fbc-3e4d61a67f32 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:57:59.933150 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7fc82891-3352-48e8-9fbc-3e4d61a67f32 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:57:59.940145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7fc82891-3352-48e8-9fbc-3e4d61a67f32 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:59.940615 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7fc82891-3352-48e8-9fbc-3e4d61a67f32 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:57:59.941372 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7fc82891-3352-48e8-9fbc-3e4d61a67f32 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:57:59.941809 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7fc82891-3352-48e8-9fbc-3e4d61a67f32 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:00.076344 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7fc82891-3352-48e8-9fbc-3e4d61a67f32 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:00.084690 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7fc82891-3352-48e8-9fbc-3e4d61a67f32 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.155996 Aug 02 08:58:00.085261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 185/385] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:57:59 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:00.607932 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:00.608488 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:00.610750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=49 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:00.616214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:00.616660 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:00.617424 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:00.617861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:00.748302 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:00.756800 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:00.758311 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:00.759470 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d829d463-3a6d-4fb4-b1b2-07d868fed557 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.155548 Aug 02 08:58:00.760021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 201/386] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:00 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:01.105868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-410580dc-c982-49f5-b7ca-1dbd6a6ff22a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:01.106478 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-410580dc-c982-49f5-b7ca-1dbd6a6ff22a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:01.113530 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-410580dc-c982-49f5-b7ca-1dbd6a6ff22a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:01.113981 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-410580dc-c982-49f5-b7ca-1dbd6a6ff22a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:01.114760 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-410580dc-c982-49f5-b7ca-1dbd6a6ff22a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:01.115204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-410580dc-c982-49f5-b7ca-1dbd6a6ff22a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:01.245752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-410580dc-c982-49f5-b7ca-1dbd6a6ff22a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:01.253725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-410580dc-c982-49f5-b7ca-1dbd6a6ff22a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1723 microversion: 2.1 time: 0.151745 Aug 02 08:58:01.254310 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 186/387] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:01 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:01.783771 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:01.784435 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:01.790895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:01.791344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:01.792106 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:01.792571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:01.918811 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:01.926637 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:01.928143 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:01.929279 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fd0a7e91-e1b8-4b6e-bbae-04855e19f37a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.150247 Aug 02 08:58:01.929857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 202/388] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:01 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:02.275067 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f58d884b-bba6-445a-b55f-4b300b6f35ba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:02.275587 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f58d884b-bba6-445a-b55f-4b300b6f35ba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:02.282206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f58d884b-bba6-445a-b55f-4b300b6f35ba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:02.282662 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f58d884b-bba6-445a-b55f-4b300b6f35ba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:02.283429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f58d884b-bba6-445a-b55f-4b300b6f35ba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:02.283869 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f58d884b-bba6-445a-b55f-4b300b6f35ba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:02.426473 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f58d884b-bba6-445a-b55f-4b300b6f35ba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:02.435123 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f58d884b-bba6-445a-b55f-4b300b6f35ba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1700 microversion: 2.1 time: 0.163911 Aug 02 08:58:02.444019 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 187/389] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:02 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:02.457110 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9a6fa2c6-19fa-49e4-9b9e-0177ce4e4040 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:02.464737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9a6fa2c6-19fa-49e4-9b9e-0177ce4e4040 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:02.465196 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9a6fa2c6-19fa-49e4-9b9e-0177ce4e4040 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:02.532096 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9a6fa2c6-19fa-49e4-9b9e-0177ce4e4040 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Going to try to start instance {{(pid=117773) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 08:58:02.587450 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9a6fa2c6-19fa-49e4-9b9e-0177ce4e4040 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/action" status: 202 len: 0 microversion: 2.1 time: 0.134019 Aug 02 08:58:02.588704 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 203/390] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 08:58:02 2022] POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:58:02.598074 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9baa0484-ea3c-4ff8-a425-c05341d57cb9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:02.598752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9baa0484-ea3c-4ff8-a425-c05341d57cb9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:02.605598 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9baa0484-ea3c-4ff8-a425-c05341d57cb9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:02.606001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9baa0484-ea3c-4ff8-a425-c05341d57cb9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:02.606791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9baa0484-ea3c-4ff8-a425-c05341d57cb9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:02.607300 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9baa0484-ea3c-4ff8-a425-c05341d57cb9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:02.748333 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9baa0484-ea3c-4ff8-a425-c05341d57cb9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:02.756395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9baa0484-ea3c-4ff8-a425-c05341d57cb9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1709 microversion: 2.1 time: 0.163140 Aug 02 08:58:02.756957 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 188/391] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:02 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:02.953063 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:02.954330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:02.961238 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:02.961886 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:02.962825 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:02.963413 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:03.103544 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:03.111589 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:03.113189 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:03.114349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6f92013d-8111-4b4f-9e44-d84338f57de9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.165487 Aug 02 08:58:03.114910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 204/392] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:02 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:03.777783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1c5d1ffd-e367-437d-a13f-18c4df45bb28 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:03.778384 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1c5d1ffd-e367-437d-a13f-18c4df45bb28 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:03.784911 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1c5d1ffd-e367-437d-a13f-18c4df45bb28 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:03.785353 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1c5d1ffd-e367-437d-a13f-18c4df45bb28 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:03.786107 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1c5d1ffd-e367-437d-a13f-18c4df45bb28 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:03.786538 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1c5d1ffd-e367-437d-a13f-18c4df45bb28 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:03.913230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1c5d1ffd-e367-437d-a13f-18c4df45bb28 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:03.916578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=100 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:03.921847 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1c5d1ffd-e367-437d-a13f-18c4df45bb28 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1709 microversion: 2.1 time: 0.147913 Aug 02 08:58:03.922401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 189/393] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:03 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:04.137384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:04.137984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:04.144463 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:04.144910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:04.145673 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:04.146109 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:04.273425 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:04.281253 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:04.283251 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:04.284428 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ffaf99c0-287a-4de1-a3ac-b848c2d11c87 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.150931 Aug 02 08:58:04.284980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 205/394] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:04 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:04.943176 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b7a6371c-6021-4caf-abdc-8a767841e5dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:04.943708 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b7a6371c-6021-4caf-abdc-8a767841e5dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:04.950326 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b7a6371c-6021-4caf-abdc-8a767841e5dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:04.950772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b7a6371c-6021-4caf-abdc-8a767841e5dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:04.951532 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b7a6371c-6021-4caf-abdc-8a767841e5dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:04.951968 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b7a6371c-6021-4caf-abdc-8a767841e5dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:05.080443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b7a6371c-6021-4caf-abdc-8a767841e5dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:05.088857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b7a6371c-6021-4caf-abdc-8a767841e5dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1709 microversion: 2.1 time: 0.149608 Aug 02 08:58:05.089505 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 190/395] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:04 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:05.307991 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:05.308652 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:05.315754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:05.316230 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:05.317000 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:05.317554 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:05.452700 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:05.461370 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:05.462877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:05.464072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-36dd8a1f-7638-4d20-b6f7-77e08052dade tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.160033 Aug 02 08:58:05.464656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 206/396] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:05 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:06.110849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b4a8ef74-5a02-49f8-b884-43bd40e4fff8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:06.111520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b4a8ef74-5a02-49f8-b884-43bd40e4fff8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:06.118056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4a8ef74-5a02-49f8-b884-43bd40e4fff8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:06.118502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4a8ef74-5a02-49f8-b884-43bd40e4fff8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:06.119294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4a8ef74-5a02-49f8-b884-43bd40e4fff8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:06.119743 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b4a8ef74-5a02-49f8-b884-43bd40e4fff8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:06.248934 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b4a8ef74-5a02-49f8-b884-43bd40e4fff8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:06.258472 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b4a8ef74-5a02-49f8-b884-43bd40e4fff8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1709 microversion: 2.1 time: 0.151042 Aug 02 08:58:06.259038 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 191/397] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:06 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:06.486981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:06.487524 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:06.494680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:06.495125 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:06.495876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:06.496335 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:06.626242 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:06.634027 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:06.635529 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:06.636794 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4fdbf27f-9af1-49dd-98c2-3cef0141ed51 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.153868 Aug 02 08:58:06.637351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 207/398] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:06 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:07.095230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-b4ec6fb4-6a62-4c1b-b8e9-ae3db1bead11 req-93cc1e7c-5352-418c-8d78-d06960ea37da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f9c72f-350b-428c-b020-d16159e0c991", "name": "network-vif-plugged", "status": "completed", "tag": "f3e02b9c-83d3-460c-8aac-b98eba055bb0"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:07.105635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b4ec6fb4-6a62-4c1b-b8e9-ae3db1bead11 req-93cc1e7c-5352-418c-8d78-d06960ea37da service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:07.106121 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b4ec6fb4-6a62-4c1b-b8e9-ae3db1bead11 req-93cc1e7c-5352-418c-8d78-d06960ea37da service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:07.118132 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-b4ec6fb4-6a62-4c1b-b8e9-ae3db1bead11 req-93cc1e7c-5352-418c-8d78-d06960ea37da service nova] Creating event network-vif-plugged:f3e02b9c-83d3-460c-8aac-b98eba055bb0 for instance b1f9c72f-350b-428c-b020-d16159e0c991 on hv-cinder-78729 Aug 02 08:58:07.123147 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-b4ec6fb4-6a62-4c1b-b8e9-ae3db1bead11 req-93cc1e7c-5352-418c-8d78-d06960ea37da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Aug 02 08:58:07.123912 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 192/399] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:07.278856 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-202c2252-278c-4f76-a2fe-75f28368002a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:07.279475 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-202c2252-278c-4f76-a2fe-75f28368002a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:07.286086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-202c2252-278c-4f76-a2fe-75f28368002a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:07.286538 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-202c2252-278c-4f76-a2fe-75f28368002a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:07.287306 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-202c2252-278c-4f76-a2fe-75f28368002a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:07.287747 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-202c2252-278c-4f76-a2fe-75f28368002a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:07.415733 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-202c2252-278c-4f76-a2fe-75f28368002a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:07.424647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-202c2252-278c-4f76-a2fe-75f28368002a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1709 microversion: 2.1 time: 0.149068 Aug 02 08:58:07.425949 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 208/400] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:07 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:07.660855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:07.661475 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:07.667684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:07.668144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:07.668920 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:07.669358 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:07.797314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:07.805475 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:07.806981 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:07.808145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-20cad6ac-be68-440a-9691-99147198f107 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.152349 Aug 02 08:58:07.808736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 193/401] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:07 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:08.446868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-508ef32f-ca21-4aee-9ed3-df5bf8f66ae6 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:08.447458 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-508ef32f-ca21-4aee-9ed3-df5bf8f66ae6 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:08.453801 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-508ef32f-ca21-4aee-9ed3-df5bf8f66ae6 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:08.454238 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-508ef32f-ca21-4aee-9ed3-df5bf8f66ae6 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:08.454994 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-508ef32f-ca21-4aee-9ed3-df5bf8f66ae6 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:08.455933 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-508ef32f-ca21-4aee-9ed3-df5bf8f66ae6 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:08.476923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:08.589602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-508ef32f-ca21-4aee-9ed3-df5bf8f66ae6 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:08.598255 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-508ef32f-ca21-4aee-9ed3-df5bf8f66ae6 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1709 microversion: 2.1 time: 0.155249 Aug 02 08:58:08.598824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 209/402] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:08 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:58:08.831940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:08.832956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:08.839625 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:08.840072 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:08.840882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:08.841320 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:08.969278 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:08.977115 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:08.978632 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:08.979792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e9f74ed1-ce34-4383-bba3-4626b8d5d812 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.152786 Aug 02 08:58:08.980399 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 194/403] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:08 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:09.619417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-502b330b-88da-4fac-8a07-d4569cc0b84a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:09.620023 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-502b330b-88da-4fac-8a07-d4569cc0b84a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:09.626516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-502b330b-88da-4fac-8a07-d4569cc0b84a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:09.626961 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-502b330b-88da-4fac-8a07-d4569cc0b84a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:09.627762 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-502b330b-88da-4fac-8a07-d4569cc0b84a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:09.628226 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-502b330b-88da-4fac-8a07-d4569cc0b84a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:09.754310 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-502b330b-88da-4fac-8a07-d4569cc0b84a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:09.762383 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-502b330b-88da-4fac-8a07-d4569cc0b84a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1709 microversion: 2.1 time: 0.146917 Aug 02 08:58:09.762949 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 210/404] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:09 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1709 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:10.007483 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:10.008389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:10.016807 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:10.017283 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:10.018878 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:10.020675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:10.158504 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:10.167955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:10.169492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:10.170639 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2064efd3-0745-4e8f-846c-9ec3a598a1fc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1745 microversion: 2.20 time: 0.171349 Aug 02 08:58:10.171199 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 195/405] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:09 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:10.783848 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-93c5c438-4ea3-4a1d-be07-e8cae87a9abf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:10.784508 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-93c5c438-4ea3-4a1d-be07-e8cae87a9abf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:10.791166 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-93c5c438-4ea3-4a1d-be07-e8cae87a9abf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:10.791621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-93c5c438-4ea3-4a1d-be07-e8cae87a9abf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:10.792422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-93c5c438-4ea3-4a1d-be07-e8cae87a9abf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:10.792893 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-93c5c438-4ea3-4a1d-be07-e8cae87a9abf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:10.929286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-93c5c438-4ea3-4a1d-be07-e8cae87a9abf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:10.937398 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-93c5c438-4ea3-4a1d-be07-e8cae87a9abf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1713 microversion: 2.1 time: 0.157376 Aug 02 08:58:10.937963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 211/406] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:58:10 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:11.193305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:11.194887 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:11.203374 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:11.204011 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:11.205114 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:11.205705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:11.364599 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:11.373087 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:11.374613 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:11.375753 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c8644d67-f982-49a6-ab15-adec8bc91432 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.186267 Aug 02 08:58:11.376322 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 196/407] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:11 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:12.400386 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:12.401541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:12.410691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:12.411261 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:12.412105 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:12.412811 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:12.588351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:12.597492 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:12.599072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:12.600550 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-090b0b71-fb06-445e-965b-0b01476bf734 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.204199 Aug 02 08:58:12.601103 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 212/408] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:12 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:13.624773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:13.625377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:13.632463 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:13.633172 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:13.634215 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:13.634918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:13.796304 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:13.804549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:13.806352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:13.807853 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a928a93c-d322-46ae-96d7-f958f62d673d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.187077 Aug 02 08:58:13.815507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 197/409] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:13 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:14.842612 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:14.843278 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:14.850254 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:14.850699 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:14.851467 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:14.851901 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:15.001605 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:15.010692 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:15.012222 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:15.013526 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1bfe1a12-4def-47b5-a1b0-e5ce6d126ab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.175791 Aug 02 08:58:15.014095 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 213/410] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:14 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:16.056952 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:16.058382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:16.065286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:16.065839 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:16.066606 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:16.067585 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:16.201218 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:16.210070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:16.211578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:16.212761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-21fd3516-3e8c-4f4b-a04b-17f2fd7dca9d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.159954 Aug 02 08:58:16.213306 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 198/411] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:16 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:17.237034 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:17.238456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:17.247377 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:17.247756 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:17.248813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:17.249190 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:17.392335 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:17.401253 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:17.402926 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:17.404027 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-79ede690-18d6-4b3f-9b97-1db27937d8f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.171526 Aug 02 08:58:17.404848 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 214/412] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:17 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:18.432279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:18.433031 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:18.440879 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:18.441349 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:18.442228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:18.442708 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:18.595346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:18.605601 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:18.607781 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:18.608985 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5a111167-21c9-4c6d-b252-6545507d5006 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.181496 Aug 02 08:58:18.609733 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 199/413] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:18 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:19.633908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:19.634500 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:19.641304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:19.641980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:19.642966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:19.643605 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:19.855714 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:19.867764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:19.869460 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:19.871144 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-af8c59d4-33d3-4c2e-9415-6a5b50255ed6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.241553 Aug 02 08:58:19.873125 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 215/414] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:19 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:20.895024 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:20.895526 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:20.902979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:20.903429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:20.904834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:20.904834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:21.060816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:21.072493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:21.074363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:21.075946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ee12cbcd-e665-40ff-b381-08ec6a517867 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.184980 Aug 02 08:58:21.077553 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 200/415] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:20 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:22.099641 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:22.100466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:22.107968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:22.108615 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:22.109460 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:22.110054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:22.253842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:22.262774 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:22.264304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:22.265469 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-378de7d8-d909-48c9-86d8-ef4318f811a4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.170494 Aug 02 08:58:22.266207 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 216/416] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:22 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:23.291461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:23.292102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:23.298644 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:23.299095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:23.299862 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:23.300336 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:23.430392 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:23.438508 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:23.440010 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:23.441186 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-470b3af2-6cc9-430d-9be2-c7df80733675 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.153632 Aug 02 08:58:23.442372 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 201/417] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:23 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:24.464587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:24.465210 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:24.471850 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:24.472335 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:24.473603 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:24.474044 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:24.601384 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:24.609207 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:24.610720 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:24.611863 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1b337412-81ed-4b14-88ad-57b3eedc3844 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.151193 Aug 02 08:58:24.612459 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 217/418] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:24 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:25.635376 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:25.635983 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:25.642447 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:25.642888 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:25.643639 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:25.644065 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:25.771461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:25.779317 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:25.780852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:25.781993 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-20b977f9-113a-4359-aa6c-02eb889c19ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.150523 Aug 02 08:58:25.782557 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 202/419] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:25 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:26.805988 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:26.806364 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:26.812776 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:26.813226 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:26.814000 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:26.814441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:26.944390 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:26.952494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:26.953996 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:26.955142 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4acdbd3d-8dd6-4854-81d2-2d2018ef762e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1740 microversion: 2.20 time: 0.154160 Aug 02 08:58:26.955689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 218/420] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:26 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:27.979056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:27.979812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:27.986260 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:27.986705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:27.987453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:27.987882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:28.115232 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:28.124375 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:28.125892 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:28.127038 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-03c2390b-30a7-40a9-9c96-d4bc5fa35f01 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1722 microversion: 2.20 time: 0.151986 Aug 02 08:58:28.127595 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 203/421] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:27 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:29.150635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:29.151149 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:29.157972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:29.158424 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:29.159194 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:29.159630 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:29.289024 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:29.297031 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:29.298545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:29.299687 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-17210397-d56a-4d14-87af-0ca251573d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1722 microversion: 2.20 time: 0.153053 Aug 02 08:58:29.300264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 219/422] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:29 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:29.845872 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-06111483-2503-4e96-848f-3114f3b7c5f7 req-2bd1fe88-93e7-444d-adef-0cd1967d7ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f9c72f-350b-428c-b020-d16159e0c991", "name": "network-vif-unplugged", "status": "completed", "tag": "f3e02b9c-83d3-460c-8aac-b98eba055bb0"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:29.851835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=40 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:29.857985 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-06111483-2503-4e96-848f-3114f3b7c5f7 req-2bd1fe88-93e7-444d-adef-0cd1967d7ef4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:29.858433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-06111483-2503-4e96-848f-3114f3b7c5f7 req-2bd1fe88-93e7-444d-adef-0cd1967d7ef4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:29.871463 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-06111483-2503-4e96-848f-3114f3b7c5f7 req-2bd1fe88-93e7-444d-adef-0cd1967d7ef4 service nova] Creating event network-vif-unplugged:f3e02b9c-83d3-460c-8aac-b98eba055bb0 for instance b1f9c72f-350b-428c-b020-d16159e0c991 on hv-cinder-78729 Aug 02 08:58:29.876515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-06111483-2503-4e96-848f-3114f3b7c5f7 req-2bd1fe88-93e7-444d-adef-0cd1967d7ef4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034351 Aug 02 08:58:29.877252 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 204/423] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:30.324231 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:30.324867 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:30.331417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:30.331853 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:30.332889 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:30.333316 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:30.460460 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:30.468379 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:30.469870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:30.471010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1eceffae-40bb-4f08-a9eb-0369733c866d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1722 microversion: 2.20 time: 0.151447 Aug 02 08:58:30.471562 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 220/424] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:30 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:31.495062 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:31.496399 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:31.502645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:31.503098 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:31.503868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:31.504337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:31.658127 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:31.666702 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:31.668237 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:31.669395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d43261be-9077-40a7-a34a-5303d570ba5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1725 microversion: 2.20 time: 0.179087 Aug 02 08:58:31.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 205/425] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:31 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:31.692677 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-22e3cadc-8241-45ea-972e-a0c93c0b1ea1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e0534b4-c319-4a22-aafa-4cb46a148bf5"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:31.695230 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-22e3cadc-8241-45ea-972e-a0c93c0b1ea1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:31.697589 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=40 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:31.703155 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-22e3cadc-8241-45ea-972e-a0c93c0b1ea1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:31.703595 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-22e3cadc-8241-45ea-972e-a0c93c0b1ea1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:31.704571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-22e3cadc-8241-45ea-972e-a0c93c0b1ea1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:31.705222 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-22e3cadc-8241-45ea-972e-a0c93c0b1ea1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:32.017399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-22e3cadc-8241-45ea-972e-a0c93c0b1ea1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329381 Aug 02 08:58:32.018495 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 221/426] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Aug 2 08:58:31 2022] POST /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 08:58:32.150867 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-db221179-8713-4d36-b60c-6ddc59b5d6ec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:32.151756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-db221179-8713-4d36-b60c-6ddc59b5d6ec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:32.158019 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-db221179-8713-4d36-b60c-6ddc59b5d6ec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:32.158489 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-db221179-8713-4d36-b60c-6ddc59b5d6ec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:32.159269 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-db221179-8713-4d36-b60c-6ddc59b5d6ec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:32.159695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-db221179-8713-4d36-b60c-6ddc59b5d6ec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:32.203633 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-db221179-8713-4d36-b60c-6ddc59b5d6ec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117772) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 08:58:32.261773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:32.277520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-db221179-8713-4d36-b60c-6ddc59b5d6ec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/action" status: 202 len: 0 microversion: 2.20 time: 0.130179 Aug 02 08:58:32.278301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 206/427] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 2 08:58:32 2022] POST /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:58:32.286345 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:32.289589 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:32.297110 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:32.298629 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:32.299664 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:32.300282 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:32.502145 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:32.512731 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:32.515411 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:32.517068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d33ca7bf-2794-416d-a2fc-b5e58f77e91a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1751 microversion: 2.20 time: 0.234476 Aug 02 08:58:32.518282 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 222/428] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:32 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1751 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:33.541781 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:33.542412 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:33.550316 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:33.550801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:33.551573 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:33.552009 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:33.708703 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:33.722998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:33.724560 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:33.726435 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-24743162-c526-4a1e-94ba-07b7875d1f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1753 microversion: 2.20 time: 0.188083 Aug 02 08:58:33.727010 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 207/429] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:33 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:34.751863 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:34.753486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:34.764074 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:34.764548 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:34.765346 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:34.765790 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:34.795410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:35.031659 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:35.041675 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:35.043709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:35.045492 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-012b6f00-feec-4097-a891-1e526ff7350b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1753 microversion: 2.20 time: 0.299100 Aug 02 08:58:35.046356 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 223/430] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:34 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1753 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:35.335803 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-be69db19-8161-4a65-ae5b-cc05d54f98c0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:35.337550 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-be69db19-8161-4a65-ae5b-cc05d54f98c0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:35.348458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be69db19-8161-4a65-ae5b-cc05d54f98c0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:35.349369 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be69db19-8161-4a65-ae5b-cc05d54f98c0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:35.351217 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be69db19-8161-4a65-ae5b-cc05d54f98c0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:35.351897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be69db19-8161-4a65-ae5b-cc05d54f98c0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:35.382324 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-be69db19-8161-4a65-ae5b-cc05d54f98c0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/ips" status: 200 len: 149 microversion: 2.1 time: 0.050758 Aug 02 08:58:35.394226 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 208/431] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 08:58:35 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/ips => generated 149 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:36.070397 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:36.071366 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:36.078472 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:36.078911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:36.079957 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:36.080612 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:36.258395 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:36.271623 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:36.273616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:36.275055 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d3cd9b6e-e839-4e38-a0ef-04ae6c5df616 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.208614 Aug 02 08:58:36.276404 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 224/432] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:36 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:36.853527 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ba84cb2f-3ae8-4b5f-8d7e-713d3b6bb507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e49f212-657a-4f30-908a-f54bd4a1b030"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:36.856373 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ba84cb2f-3ae8-4b5f-8d7e-713d3b6bb507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:36.868398 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ba84cb2f-3ae8-4b5f-8d7e-713d3b6bb507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:36.868931 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ba84cb2f-3ae8-4b5f-8d7e-713d3b6bb507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:36.870420 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ba84cb2f-3ae8-4b5f-8d7e-713d3b6bb507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:36.871070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ba84cb2f-3ae8-4b5f-8d7e-713d3b6bb507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:37.299823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:37.300492 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:37.310038 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:37.310494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:37.311278 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:37.311724 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:37.529872 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ba84cb2f-3ae8-4b5f-8d7e-713d3b6bb507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680030 Aug 02 08:58:37.535005 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 209/433] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 08:58:36 2022] POST /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:37.642589 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:37.657260 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:37.659570 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:37.661752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-56e1ca8f-4a30-4519-81fc-bc274c5444fa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.365999 Aug 02 08:58:37.662547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 225/434] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:37 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:38.688951 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:38.690218 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:38.701481 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:38.703218 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:38.705764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:38.710502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:39.660782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:58:39.661111 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 08:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 (ip 10.222.0.17) !!! Aug 02 08:58:39.786314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:39.834814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:39.857457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:39.859088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c746be99-e74a-4583-b9ab-c7c60a04f615 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 1.174412 Aug 02 08:58:39.859810 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 210/435] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:38 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:40.886122 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:40.887485 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:40.907618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:40.908674 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:40.909699 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:40.910349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:41.124594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:41.135105 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:41.136967 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:41.139030 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-74009464-3e3c-4ee0-bb2c-7345a2528589 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.257006 Aug 02 08:58:41.140058 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 226/436] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:40 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:42.165335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:42.166819 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:42.177700 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:42.178160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:42.179040 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:42.179482 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:42.494478 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:42.505681 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:42.507871 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:42.509181 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4830cc48-4f81-4724-879a-299f1196a6ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.349589 Aug 02 08:58:42.509869 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 211/437] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:42 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:43.271893 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ed5cbb87-0c60-4b4a-8510-ab374176a64e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68d49724-3a61-477d-8bd5-accea83b65e0"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:43.274358 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ed5cbb87-0c60-4b4a-8510-ab374176a64e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:43.286828 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed5cbb87-0c60-4b4a-8510-ab374176a64e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:43.287293 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed5cbb87-0c60-4b4a-8510-ab374176a64e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:43.288091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed5cbb87-0c60-4b4a-8510-ab374176a64e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:43.288564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed5cbb87-0c60-4b4a-8510-ab374176a64e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:43.534302 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:43.536349 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:43.549890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:43.551036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:43.552030 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:43.552749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:43.721697 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:43.734235 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:43.736080 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:43.738503 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9ef227e8-00b7-4b41-8a31-807524c6e295 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.207270 Aug 02 08:58:43.740355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 212/438] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:43 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:44.077676 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-45a37cfd-4e2c-4688-9a0f-ee5ebbd191aa tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Action: 'create', calling method: .version_select at 0x7f13fac34430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1953494769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSF2UAMhXTxiq3wTrFerQjiNrEmmyPvQcJmGyPP6iK8qHt9V7sY+5GUKzNEwijBt2+sqxxOSVAbouwy5DWQYYLkWZsYYhAeypLOqym3i2OTpb1eMZHbuMvkvF2mT3xeew=="}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:44.094655 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-45a37cfd-4e2c-4688-9a0f-ee5ebbd191aa tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Getting quotas for project 8e34c8b3cec84078bbb2121ae4a279de. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:58:44.099040 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-45a37cfd-4e2c-4688-9a0f-ee5ebbd191aa tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Getting quotas for user e2cc95918e4f457f955161df0dd0ebde and project 8e34c8b3cec84078bbb2121ae4a279de. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:58:44.126902 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-45a37cfd-4e2c-4688-9a0f-ee5ebbd191aa tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.245980 Aug 02 08:58:44.127443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 213/439] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 08:58:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:44.771255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:44.771932 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:44.783725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:44.784203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:44.785820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:44.786261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:45.046435 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:45.060318 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:45.065737 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:45.069323 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7b87f7bd-7519-49d3-b520-5e806d079e8d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.309969 Aug 02 08:58:45.072443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 214/440] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:44 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:46.098708 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:46.099410 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:46.105753 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:46.106195 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:46.106949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:46.107384 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:46.268653 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:46.279332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:46.281349 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:46.282536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5fab85f7-21a2-4bf1-9d09-a97ece9128f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.188326 Aug 02 08:58:46.292933 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 215/441] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:46 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:47.308026 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:47.310376 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:47.317941 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:47.318397 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:47.319175 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:47.319640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:47.472002 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:47.483412 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:47.485425 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:47.486834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-75dd3518-ead3-4494-8a28-08e0ca3cc6f1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.183280 Aug 02 08:58:47.487887 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 216/442] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:47 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:48.308442 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:58:48.309525 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Tue Aug 2 08:58:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments (ip 10.222.0.17) !!! Aug 02 08:58:48.511722 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:48.512408 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:48.522873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:48.522873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:48.526879 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:48.527704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:48.703204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:48.714101 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:48.715623 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:48.716833 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e3a00fe8-a953-4c64-84ad-d38fc3aad125 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.210352 Aug 02 08:58:48.717401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 217/443] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:48 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:49.740101 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:49.740801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:49.747577 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:49.748022 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:49.748852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:49.749315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:49.914631 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:49.923633 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:49.925509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:49.926935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-354c5d18-643c-4256-9c04-36df1e4f46dd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.190729 Aug 02 08:58:49.927717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 218/444] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:49 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:50.950653 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:50.952110 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:50.960720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:50.961498 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:50.962520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:50.963193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:51.107834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:51.116659 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:51.118087 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:51.119482 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d55d2f92-d274-43d5-b4d4-dff6ba68c917 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.173105 Aug 02 08:58:51.120041 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 219/445] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:50 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:52.145091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:52.145749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:52.152075 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:52.152547 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:52.153300 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:52.153731 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:52.283726 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:52.292056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:52.293607 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:52.294738 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ef31a907-a483-4efe-a2bf-9665aef755f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.153565 Aug 02 08:58:52.295291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 220/446] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:52 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:53.279176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=13 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:53.317538 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:53.318143 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:53.324659 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:53.325104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:53.325865 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:53.326298 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:53.465518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:53.475144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:53.476680 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:53.477844 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-df812d4e-9911-4045-a1d9-db36f42f7660 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.164174 Aug 02 08:58:53.478398 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 221/447] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:53 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:53.483045 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=26 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:54.501555 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:54.502293 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:54.504047 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=4 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:54.510641 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:54.511126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:54.511862 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:54.512342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:54.656196 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:54.665341 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:54.666847 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:54.667990 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1eb32d27-63fe-4f74-8911-17913fcb6edb tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.170468 Aug 02 08:58:54.668582 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 222/448] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:54 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:58:54.800589 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ed5cbb87-0c60-4b4a-8510-ab374176a64e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.532521 Aug 02 08:58:54.801254 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 227/449] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 08:58:43 2022] POST /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments => generated 194 bytes in 11534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:58:55.691660 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:55.692291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:55.700076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:55.700502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:55.701280 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:55.701717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:55.723852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:55.843047 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:55.853277 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:55.854806 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:55.855963 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1fb6a2c8-bbaf-4b2e-8c20-2e6a47dc018d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.168232 Aug 02 08:58:55.856542 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 223/450] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:55 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:56.879955 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:56.880685 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:56.888327 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:56.888778 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:56.889555 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:56.889993 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:57.028709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:57.036836 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:57.039030 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:57.040242 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0de4dd7d-c44a-4aa0-b92e-918b342e613d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.165039 Aug 02 08:58:57.040801 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 228/451] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:56 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:58.062608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:58.063214 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:58.069906 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:58.070355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:58.071123 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:58.071563 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:58.203102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:58.211643 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:58.213205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:58.214449 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-38901140-6fd9-4ceb-89ec-37c8b1f91e1f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.155695 Aug 02 08:58:58.215001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 224/452] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:58 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:59.237804 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:59.238411 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:58:59.244978 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:59.245428 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:59.246198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:58:59.246640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:58:59.375826 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:59.384328 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:59.385877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:58:59.387036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-08a420d6-1b63-4f4a-bc2e-f08f25b03f23 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.153192 Aug 02 08:58:59.387592 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 229/453] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:58:59 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:00.410483 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:00.411086 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:00.413536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:00.419350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:00.419810 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:00.420651 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:00.421093 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:00.555451 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:00.563750 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:00.565281 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:00.566419 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b6da7ee3-7e0d-4bbc-8111-fa415564a240 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.159781 Aug 02 08:59:00.566973 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 225/454] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:00 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:01.589244 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:01.589857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:01.596371 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:01.596820 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:01.597583 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:01.598021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:01.723893 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:01.732906 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:01.734399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:01.735531 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-72142df0-529b-4de1-99df-e8e3cb52bd73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.150318 Aug 02 08:59:01.736080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 230/455] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:01 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:02.760164 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:02.760889 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:02.769440 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:02.769894 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:02.770670 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:02.771112 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:02.899384 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:02.908105 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:02.909616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:02.910751 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1eedc627-d7c3-4ead-8fe8-e2d641207dd5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.155447 Aug 02 08:59:02.911303 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 226/456] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:02 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:03.935211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:03.935739 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:03.942568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:03.943021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:03.943779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:03.944512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:04.072431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:04.080950 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:04.082707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:04.083849 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6102b31a-8256-4024-8fa9-6fed3cf17f70 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.152941 Aug 02 08:59:04.084450 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 231/457] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:03 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:05.107580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:05.108212 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:05.114999 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:05.115444 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:05.116235 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:05.116671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:05.244424 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:05.253102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:05.254608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:05.255787 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-04dd6336-a9b7-4e64-b41a-e747677eed10 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.152067 Aug 02 08:59:05.256386 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 227/458] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:05 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:06.278726 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:06.279327 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:06.285923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:06.286367 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:06.287120 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:06.287552 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:06.418841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:06.427134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:06.428789 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:06.430574 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-781007ca-c68a-4e53-a011-dd0fe877827c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.155695 Aug 02 08:59:06.431130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 232/459] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:06 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:07.454251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:07.454855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:07.462090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:07.462533 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:07.463292 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:07.463725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:07.601274 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:07.610633 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:07.612156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:07.613329 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6f3579fd-fb99-4128-afe6-3abbfcc9f06e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.162999 Aug 02 08:59:07.628252 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 228/460] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:07 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:07.684142 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fa311820-9316-4213-9d6c-aa7a6a008171 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: .version_select at 0x7f13faa5c040>, body: {"keypair": {"name": "tempest-keypair-160019730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXp62IojB3/tQwjhgSWLEJgF6DSb54kZsFYB9S54ToIhRSNArhfNxiUQtgBjfI/rcm/BNaBip+A0JTc70VHOZspLCOcE2tKEiBaLWNsCt062oSti3a760qi5SwjaUpeYA=="}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:07.699854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-fa311820-9316-4213-9d6c-aa7a6a008171 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for project 3179955b76864553a96682674d01b781. Resources: {'key_pairs'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:59:07.703705 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-fa311820-9316-4213-9d6c-aa7a6a008171 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for user f01062e92f974dc890897d19359e7e63 and project 3179955b76864553a96682674d01b781. Resources: {'key_pairs'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:59:07.729683 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fa311820-9316-4213-9d6c-aa7a6a008171 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049491 Aug 02 08:59:07.730264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 233/461] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 08:59:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:08.636837 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:08.637422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:08.644348 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:08.644788 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:08.645559 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:08.645993 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:08.853602 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:08.862148 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:08.863930 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:08.865113 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-aacf3683-f974-4f74-9668-5ddd20ffa8ab tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.232753 Aug 02 08:59:08.877675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 229/462] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:08 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:09.020146 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-76b1f622-76b9-4927-a2e3-d9bb2bf10175 req-e2db7a40-5a21-4e4f-94c5-30bce4420648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f9c72f-350b-428c-b020-d16159e0c991", "name": "network-vif-plugged", "status": "completed", "tag": "f3e02b9c-83d3-460c-8aac-b98eba055bb0"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:09.031074 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-76b1f622-76b9-4927-a2e3-d9bb2bf10175 req-e2db7a40-5a21-4e4f-94c5-30bce4420648 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:09.031630 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-76b1f622-76b9-4927-a2e3-d9bb2bf10175 req-e2db7a40-5a21-4e4f-94c5-30bce4420648 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:09.042985 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-76b1f622-76b9-4927-a2e3-d9bb2bf10175 req-e2db7a40-5a21-4e4f-94c5-30bce4420648 service nova] Creating event network-vif-plugged:f3e02b9c-83d3-460c-8aac-b98eba055bb0 for instance b1f9c72f-350b-428c-b020-d16159e0c991 on hv-cinder-78729 Aug 02 08:59:09.048146 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-76b1f622-76b9-4927-a2e3-d9bb2bf10175 req-e2db7a40-5a21-4e4f-94c5-30bce4420648 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032549 Aug 02 08:59:09.048984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 234/463] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:09.084972 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1943750534", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99261d5d-9777-4359-9363-b7001791ac96"}], "security_groups": [{"name": "tempest-securitygroup--804240299"}], "key_name": "tempest-keypair-160019730", "user_data": "}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:09.195792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] validate_networks() for [('99261d5d-9777-4359-9363-b7001791ac96', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:59:09.607762 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:59:09.608213 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:59:09.608688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:59:09.609096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:59:09.609662 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:59:09.621263 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:09.621711 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:09.622793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:09.623354 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:09.653922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for project 3179955b76864553a96682674d01b781. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:59:09.658666 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for user f01062e92f974dc890897d19359e7e63 and project 3179955b76864553a96682674d01b781. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:59:09.670700 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:59:09.673034 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:59:09.722713 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-01d23097-d0b0-4389-af5c-e5b3f569806a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.642340 Aug 02 08:59:09.723545 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 230/464] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:59:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:59:09.734735 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b3fda1e5-ed53-43b2-9e1b-7015b102a138 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:09.735510 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b3fda1e5-ed53-43b2-9e1b-7015b102a138 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:09.792826 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b3fda1e5-ed53-43b2-9e1b-7015b102a138 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:09.799708 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b3fda1e5-ed53-43b2-9e1b-7015b102a138 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1241 microversion: 2.1 time: 0.069107 Aug 02 08:59:09.800574 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 235/465] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:09 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:09.889906 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:09.890513 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:09.896807 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:09.897258 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:09.898021 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:09.898453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:10.033546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:10.043317 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:10.044876 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:10.046030 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d391c2e6-2b3d-4a14-a2c1-c24bf41d7742 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.160001 Aug 02 08:59:10.046579 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 231/466] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:09 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:10.822363 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-caea887c-3783-4b8f-b4df-0580cddcb46a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:10.822984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-caea887c-3783-4b8f-b4df-0580cddcb46a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:10.829721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-caea887c-3783-4b8f-b4df-0580cddcb46a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:10.830169 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-caea887c-3783-4b8f-b4df-0580cddcb46a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:10.830936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-caea887c-3783-4b8f-b4df-0580cddcb46a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:10.831374 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-caea887c-3783-4b8f-b4df-0580cddcb46a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:10.894352 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-caea887c-3783-4b8f-b4df-0580cddcb46a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:10.901811 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-caea887c-3783-4b8f-b4df-0580cddcb46a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1237 microversion: 2.1 time: 0.083358 Aug 02 08:59:10.902376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 236/467] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:10 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:11.069614 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:11.070227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:11.076468 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:11.076922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:11.077682 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:11.078122 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:11.206639 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:11.215799 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:11.217424 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:11.219119 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7522ccc4-7375-4c70-a0a3-cef602b6f686 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.153599 Aug 02 08:59:11.219676 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 232/468] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:11 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:11.924875 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-60614920-b607-4d91-9728-1a6d71770cf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:11.925933 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-60614920-b607-4d91-9728-1a6d71770cf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:11.936004 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60614920-b607-4d91-9728-1a6d71770cf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:11.936476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60614920-b607-4d91-9728-1a6d71770cf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:11.937249 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60614920-b607-4d91-9728-1a6d71770cf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:11.937680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60614920-b607-4d91-9728-1a6d71770cf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:12.001436 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-60614920-b607-4d91-9728-1a6d71770cf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:12.009526 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-60614920-b607-4d91-9728-1a6d71770cf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1293 microversion: 2.1 time: 0.090283 Aug 02 08:59:12.010106 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 237/469] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:11 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:12.244823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:12.246124 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:12.252671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:12.253147 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:12.254014 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:12.254510 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:12.389513 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:12.399099 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:12.400705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:12.401868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e96ff856-18ef-4045-9bff-6a5d41dbff73 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1809 microversion: 2.20 time: 0.163091 Aug 02 08:59:12.402427 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 233/470] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:12 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:13.030331 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b2a6ae6f-18c2-4b5a-923c-da19125db284 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:13.030979 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b2a6ae6f-18c2-4b5a-923c-da19125db284 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:13.037596 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae6f-18c2-4b5a-923c-da19125db284 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:13.038051 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae6f-18c2-4b5a-923c-da19125db284 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:13.038822 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae6f-18c2-4b5a-923c-da19125db284 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:13.039263 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae6f-18c2-4b5a-923c-da19125db284 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:13.100283 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b2a6ae6f-18c2-4b5a-923c-da19125db284 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:13.107823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b2a6ae6f-18c2-4b5a-923c-da19125db284 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1299 microversion: 2.1 time: 0.081345 Aug 02 08:59:13.108418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 238/471] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:13 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:13.426505 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:13.427266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:13.434763 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:13.435445 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:13.436576 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:13.436768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:13.508833 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-467505394", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1953494769", "security_groups": [{"name": "tempest-secgroup-smoke-566442336"}], "networks": [{"uuid": "ebf57e64-6615-4fa1-aa90-93b5f2680be6"}], "block_device_mapping_v2": [{"uuid": "08eb7187-0670-4782-b9d1-0f2732626357", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:13.624738 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] validate_networks() for [('ebf57e64-6615-4fa1-aa90-93b5f2680be6', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:59:13.750195 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:13.759979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:13.761624 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:13.763215 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8a3b8ce2-d7c5-43ff-b223-24f06cc88d13 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1796 microversion: 2.20 time: 0.340775 Aug 02 08:59:13.764007 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 234/472] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 08:59:13 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1796 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:14.095352 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:59:14.095888 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:59:14.096329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:59:14.096736 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:59:14.097143 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:59:14.106616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:14.107066 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:14.107908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:14.108326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:14.129089 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c0599e23-ab47-4777-8453-6bc01f6eabcc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:14.129228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c0599e23-ab47-4777-8453-6bc01f6eabcc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:14.136766 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Getting quotas for project 8e34c8b3cec84078bbb2121ae4a279de. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:59:14.141104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0599e23-ab47-4777-8453-6bc01f6eabcc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:14.141547 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0599e23-ab47-4777-8453-6bc01f6eabcc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:14.141675 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Getting quotas for user e2cc95918e4f457f955161df0dd0ebde and project 8e34c8b3cec84078bbb2121ae4a279de. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:59:14.142951 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0599e23-ab47-4777-8453-6bc01f6eabcc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:14.143393 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0599e23-ab47-4777-8453-6bc01f6eabcc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:14.207474 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:59:14.209619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08eb7187-0670-4782-b9d1-0f2732626357',volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:59:14.344060 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c0599e23-ab47-4777-8453-6bc01f6eabcc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:14.357261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c0599e23-ab47-4777-8453-6bc01f6eabcc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1366 microversion: 2.1 time: 0.232373 Aug 02 08:59:14.372372 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 235/473] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:14 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:14.393060 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f6f22b0b-e35f-440f-8571-6ba58cfd2e17 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.888501 Aug 02 08:59:14.405879 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4df313a2-4df7-4d69-aa73-5852e7598b14 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:14.406487 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4df313a2-4df7-4d69-aa73-5852e7598b14 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:14.412339 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 239/474] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 08:59:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 08:59:14.495607 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4df313a2-4df7-4d69-aa73-5852e7598b14 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:14.502592 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4df313a2-4df7-4d69-aa73-5852e7598b14 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1088 microversion: 2.1 time: 0.100634 Aug 02 08:59:14.503164 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 236/475] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:14 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1088 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:15.066455 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-7614dba3-c33a-4fca-9db3-049460f47919 req-95101244-fcb6-4d74-ad31-315b0a6b5f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d22468-69c0-45b8-8ee0-0bc6247befa7", "tag": "37c8c717-c415-4033-831f-a3fe6f63a25e"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:15.077998 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-7614dba3-c33a-4fca-9db3-049460f47919 req-95101244-fcb6-4d74-ad31-315b0a6b5f0b service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.078452 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-7614dba3-c33a-4fca-9db3-049460f47919 req-95101244-fcb6-4d74-ad31-315b0a6b5f0b service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.090963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-7614dba3-c33a-4fca-9db3-049460f47919 req-95101244-fcb6-4d74-ad31-315b0a6b5f0b service nova] Creating event network-changed:37c8c717-c415-4033-831f-a3fe6f63a25e for instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 on hv-cinder-78729 Aug 02 08:59:15.098749 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-7614dba3-c33a-4fca-9db3-049460f47919 req-95101244-fcb6-4d74-ad31-315b0a6b5f0b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128404 Aug 02 08:59:15.100051 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 240/476] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:15.109988 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8a2cf48f-7694-40a4-9126-71a38be96e50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:15.112552 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8a2cf48f-7694-40a4-9126-71a38be96e50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:15.119686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a2cf48f-7694-40a4-9126-71a38be96e50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.120144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a2cf48f-7694-40a4-9126-71a38be96e50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.120924 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a2cf48f-7694-40a4-9126-71a38be96e50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.121352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a2cf48f-7694-40a4-9126-71a38be96e50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.143707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-8a2cf48f-7694-40a4-9126-71a38be96e50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lazy-loading 'flavor' on Instance uuid f003d009-ff7f-402b-8909-26d0e4ed705a {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:59:15.282030 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8a2cf48f-7694-40a4-9126-71a38be96e50 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/action" status: 200 len: 32 microversion: 2.1 time: 0.176904 Aug 02 08:59:15.282640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 237/477] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 08:59:15 2022] POST /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 08:59:15.293312 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-df0fd08b-a97d-48e0-aea6-266e064cda43 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:15.294014 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-df0fd08b-a97d-48e0-aea6-266e064cda43 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:15.300386 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df0fd08b-a97d-48e0-aea6-266e064cda43 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.300837 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df0fd08b-a97d-48e0-aea6-266e064cda43 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.301603 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df0fd08b-a97d-48e0-aea6-266e064cda43 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.302037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df0fd08b-a97d-48e0-aea6-266e064cda43 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.381196 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c7bc0e63-7a67-484a-b8b4-75f1fa2c2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:15.381802 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c7bc0e63-7a67-484a-b8b4-75f1fa2c2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:15.388572 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c7bc0e63-7a67-484a-b8b4-75f1fa2c2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.389019 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c7bc0e63-7a67-484a-b8b4-75f1fa2c2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.389774 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c7bc0e63-7a67-484a-b8b4-75f1fa2c2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.390712 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c7bc0e63-7a67-484a-b8b4-75f1fa2c2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.443882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-df0fd08b-a97d-48e0-aea6-266e064cda43 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:15.452579 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-df0fd08b-a97d-48e0-aea6-266e064cda43 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.164163 Aug 02 08:59:15.453150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 241/478] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:15 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:15.522888 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1861ccb3-27e5-4b76-a4f6-7c05be4082a6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:15.524581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c7bc0e63-7a67-484a-b8b4-75f1fa2c2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:15.525060 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1861ccb3-27e5-4b76-a4f6-7c05be4082a6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:15.530879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1861ccb3-27e5-4b76-a4f6-7c05be4082a6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.531321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1861ccb3-27e5-4b76-a4f6-7c05be4082a6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.531932 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c7bc0e63-7a67-484a-b8b4-75f1fa2c2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1366 microversion: 2.1 time: 0.155002 Aug 02 08:59:15.532082 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1861ccb3-27e5-4b76-a4f6-7c05be4082a6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:15.532528 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 238/479] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:15 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:15.532658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1861ccb3-27e5-4b76-a4f6-7c05be4082a6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:15.593411 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1861ccb3-27e5-4b76-a4f6-7c05be4082a6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:15.600858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1861ccb3-27e5-4b76-a4f6-7c05be4082a6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1186 microversion: 2.1 time: 0.081930 Aug 02 08:59:15.601422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 242/480] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:15 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:16.474467 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b3087c7c-7155-4cf5-9252-806dd8b2d19a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:16.475226 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b3087c7c-7155-4cf5-9252-806dd8b2d19a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:16.482391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b3087c7c-7155-4cf5-9252-806dd8b2d19a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:16.482840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b3087c7c-7155-4cf5-9252-806dd8b2d19a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:16.483614 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b3087c7c-7155-4cf5-9252-806dd8b2d19a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:16.484065 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b3087c7c-7155-4cf5-9252-806dd8b2d19a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:16.552729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-66394fa8-2208-49d6-9ddf-6a4f18ff8dce tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:16.553438 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-66394fa8-2208-49d6-9ddf-6a4f18ff8dce tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:16.560434 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-66394fa8-2208-49d6-9ddf-6a4f18ff8dce tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:16.560978 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-66394fa8-2208-49d6-9ddf-6a4f18ff8dce tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:16.561836 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-66394fa8-2208-49d6-9ddf-6a4f18ff8dce tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:16.562454 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-66394fa8-2208-49d6-9ddf-6a4f18ff8dce tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:16.629984 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b3087c7c-7155-4cf5-9252-806dd8b2d19a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:16.633752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:16.641673 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b3087c7c-7155-4cf5-9252-806dd8b2d19a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.170995 Aug 02 08:59:16.642637 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 239/481] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:16 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:16.642637 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9df7fc0b-cf1e-4c64-89e5-3ef79245b939 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:16.649041 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9df7fc0b-cf1e-4c64-89e5-3ef79245b939 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:16.656586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9df7fc0b-cf1e-4c64-89e5-3ef79245b939 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:16.657369 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9df7fc0b-cf1e-4c64-89e5-3ef79245b939 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:16.658845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9df7fc0b-cf1e-4c64-89e5-3ef79245b939 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:16.659494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9df7fc0b-cf1e-4c64-89e5-3ef79245b939 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:16.725926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9df7fc0b-cf1e-4c64-89e5-3ef79245b939 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:16.734216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9df7fc0b-cf1e-4c64-89e5-3ef79245b939 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1204 microversion: 2.1 time: 0.090477 Aug 02 08:59:16.734796 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 240/482] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:16 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:16.760054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-66394fa8-2208-49d6-9ddf-6a4f18ff8dce tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:16.767867 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-66394fa8-2208-49d6-9ddf-6a4f18ff8dce tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1366 microversion: 2.1 time: 0.219052 Aug 02 08:59:16.768665 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 243/483] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:16 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:17.667232 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d12157bc-45a3-45ea-8962-39112c5ba11b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:17.667876 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d12157bc-45a3-45ea-8962-39112c5ba11b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:17.674290 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d12157bc-45a3-45ea-8962-39112c5ba11b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:17.674734 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d12157bc-45a3-45ea-8962-39112c5ba11b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:17.675487 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d12157bc-45a3-45ea-8962-39112c5ba11b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:17.675918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d12157bc-45a3-45ea-8962-39112c5ba11b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:17.754879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1c5667b9-b9b8-4f66-b1bf-a4545b3f5400 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:17.755884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1c5667b9-b9b8-4f66-b1bf-a4545b3f5400 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:17.762068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1c5667b9-b9b8-4f66-b1bf-a4545b3f5400 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:17.762521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1c5667b9-b9b8-4f66-b1bf-a4545b3f5400 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:17.763292 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1c5667b9-b9b8-4f66-b1bf-a4545b3f5400 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:17.763790 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1c5667b9-b9b8-4f66-b1bf-a4545b3f5400 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:17.807636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d12157bc-45a3-45ea-8962-39112c5ba11b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:17.816272 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d12157bc-45a3-45ea-8962-39112c5ba11b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.153278 Aug 02 08:59:17.816948 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 241/484] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:17 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:17.821490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ace2b248-5a8e-4858-90e7-3208a8bba33d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:17.822170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ace2b248-5a8e-4858-90e7-3208a8bba33d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:17.828806 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ace2b248-5a8e-4858-90e7-3208a8bba33d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:17.829336 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ace2b248-5a8e-4858-90e7-3208a8bba33d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:17.830118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ace2b248-5a8e-4858-90e7-3208a8bba33d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:17.830558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ace2b248-5a8e-4858-90e7-3208a8bba33d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:17.895913 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1c5667b9-b9b8-4f66-b1bf-a4545b3f5400 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:17.903885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1c5667b9-b9b8-4f66-b1bf-a4545b3f5400 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1271 microversion: 2.1 time: 0.152824 Aug 02 08:59:17.904498 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 244/485] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:17 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:17.961477 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ace2b248-5a8e-4858-90e7-3208a8bba33d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:17.968923 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ace2b248-5a8e-4858-90e7-3208a8bba33d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1366 microversion: 2.1 time: 0.150963 Aug 02 08:59:17.969484 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 242/486] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:17 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:18.839347 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e108381c-db2e-4efa-a649-145d49de7441 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:18.840832 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e108381c-db2e-4efa-a649-145d49de7441 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:18.850088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e108381c-db2e-4efa-a649-145d49de7441 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:18.850973 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e108381c-db2e-4efa-a649-145d49de7441 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:18.852773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e108381c-db2e-4efa-a649-145d49de7441 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:18.853490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e108381c-db2e-4efa-a649-145d49de7441 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:18.925484 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4030193e-9b15-4a56-98c2-6a3b9f990797 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:18.926177 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4030193e-9b15-4a56-98c2-6a3b9f990797 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:18.933749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4030193e-9b15-4a56-98c2-6a3b9f990797 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:18.934586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4030193e-9b15-4a56-98c2-6a3b9f990797 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:18.935601 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4030193e-9b15-4a56-98c2-6a3b9f990797 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:18.936318 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4030193e-9b15-4a56-98c2-6a3b9f990797 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:19.115818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e108381c-db2e-4efa-a649-145d49de7441 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:19.126292 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e108381c-db2e-4efa-a649-145d49de7441 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.291810 Aug 02 08:59:19.127144 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 245/487] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:18 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:19.143489 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-caa6cfc8-d34a-44ab-9cdc-683b87dd8a4d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:19.144448 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-caa6cfc8-d34a-44ab-9cdc-683b87dd8a4d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:19.153990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-caa6cfc8-d34a-44ab-9cdc-683b87dd8a4d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:19.155267 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-caa6cfc8-d34a-44ab-9cdc-683b87dd8a4d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:19.156445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-caa6cfc8-d34a-44ab-9cdc-683b87dd8a4d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:19.157130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-caa6cfc8-d34a-44ab-9cdc-683b87dd8a4d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:19.206643 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4030193e-9b15-4a56-98c2-6a3b9f990797 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:19.217618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4030193e-9b15-4a56-98c2-6a3b9f990797 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.296966 Aug 02 08:59:19.223368 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 243/488] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:18 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:19.337696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-349acec7-1678-45c7-90bf-2db712cf56d7 req-fbfcea8a-2911-4cdb-9220-d74decc3ffa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3981c8ca-8909-4516-8813-e3a3cd71960b", "tag": "4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:19.347531 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-349acec7-1678-45c7-90bf-2db712cf56d7 req-fbfcea8a-2911-4cdb-9220-d74decc3ffa6 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:19.348314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-349acec7-1678-45c7-90bf-2db712cf56d7 req-fbfcea8a-2911-4cdb-9220-d74decc3ffa6 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:19.359838 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-349acec7-1678-45c7-90bf-2db712cf56d7 req-fbfcea8a-2911-4cdb-9220-d74decc3ffa6 service nova] Creating event network-changed:4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55 for instance 3981c8ca-8909-4516-8813-e3a3cd71960b on hv-cinder-78729 Aug 02 08:59:19.365007 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-349acec7-1678-45c7-90bf-2db712cf56d7 req-fbfcea8a-2911-4cdb-9220-d74decc3ffa6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094882 Aug 02 08:59:19.365604 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 244/489] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:59:19.424712 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-caa6cfc8-d34a-44ab-9cdc-683b87dd8a4d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:19.432709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-caa6cfc8-d34a-44ab-9cdc-683b87dd8a4d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1366 microversion: 2.1 time: 0.304285 Aug 02 08:59:19.433271 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 246/490] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:19 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:20.145574 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:20.151245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9e09452d-3d89-45cb-9f60-c7b11ea63753 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:20.151947 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9e09452d-3d89-45cb-9f60-c7b11ea63753 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:20.158478 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9e09452d-3d89-45cb-9f60-c7b11ea63753 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:20.158919 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9e09452d-3d89-45cb-9f60-c7b11ea63753 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:20.159683 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9e09452d-3d89-45cb-9f60-c7b11ea63753 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:20.160140 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9e09452d-3d89-45cb-9f60-c7b11ea63753 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:20.239587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fac7a6ad-fe72-49a8-a9d6-69a5b69f347d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:20.240353 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fac7a6ad-fe72-49a8-a9d6-69a5b69f347d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:20.246519 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fac7a6ad-fe72-49a8-a9d6-69a5b69f347d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:20.246965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fac7a6ad-fe72-49a8-a9d6-69a5b69f347d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:20.247724 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fac7a6ad-fe72-49a8-a9d6-69a5b69f347d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:20.248182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fac7a6ad-fe72-49a8-a9d6-69a5b69f347d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:20.252326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:20.297994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9e09452d-3d89-45cb-9f60-c7b11ea63753 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:20.305969 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9e09452d-3d89-45cb-9f60-c7b11ea63753 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.161425 Aug 02 08:59:20.306536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 245/491] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:20 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:20.383972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fac7a6ad-fe72-49a8-a9d6-69a5b69f347d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:20.391350 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fac7a6ad-fe72-49a8-a9d6-69a5b69f347d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.155623 Aug 02 08:59:20.391903 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 247/492] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:20 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:20.454865 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2ee423be-958d-4341-93c4-b4053ed4bf61 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:20.455399 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2ee423be-958d-4341-93c4-b4053ed4bf61 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:20.462817 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ee423be-958d-4341-93c4-b4053ed4bf61 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:20.463267 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ee423be-958d-4341-93c4-b4053ed4bf61 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:20.464058 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ee423be-958d-4341-93c4-b4053ed4bf61 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:20.464518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ee423be-958d-4341-93c4-b4053ed4bf61 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:20.592849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2ee423be-958d-4341-93c4-b4053ed4bf61 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:20.600031 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2ee423be-958d-4341-93c4-b4053ed4bf61 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1366 microversion: 2.1 time: 0.149147 Aug 02 08:59:20.600617 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 246/493] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:20 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:21.327625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d2cba63a-ddbd-43d7-9bfa-2fe5a54e04bd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:21.328352 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d2cba63a-ddbd-43d7-9bfa-2fe5a54e04bd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:21.336326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d2cba63a-ddbd-43d7-9bfa-2fe5a54e04bd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:21.336540 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d2cba63a-ddbd-43d7-9bfa-2fe5a54e04bd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:21.337323 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d2cba63a-ddbd-43d7-9bfa-2fe5a54e04bd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:21.337767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d2cba63a-ddbd-43d7-9bfa-2fe5a54e04bd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:21.412528 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b6804d0d-4b8b-463b-a58f-0368ebd28c3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:21.413139 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b6804d0d-4b8b-463b-a58f-0368ebd28c3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:21.420834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6804d0d-4b8b-463b-a58f-0368ebd28c3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:21.421582 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6804d0d-4b8b-463b-a58f-0368ebd28c3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:21.422475 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6804d0d-4b8b-463b-a58f-0368ebd28c3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:21.423448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b6804d0d-4b8b-463b-a58f-0368ebd28c3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:21.478785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d2cba63a-ddbd-43d7-9bfa-2fe5a54e04bd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:21.490433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d2cba63a-ddbd-43d7-9bfa-2fe5a54e04bd tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.167093 Aug 02 08:59:21.491403 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 248/494] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:21 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:21.565639 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-3396e76a-000f-4d2b-88e4-c44b1eaf59e1 req-53dcc261-ff4e-4fa5-9b53-d5fde4fe5ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d22468-69c0-45b8-8ee0-0bc6247befa7", "name": "network-vif-plugged", "status": "completed", "tag": "37c8c717-c415-4033-831f-a3fe6f63a25e"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:21.570898 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b6804d0d-4b8b-463b-a58f-0368ebd28c3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:21.576869 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-3396e76a-000f-4d2b-88e4-c44b1eaf59e1 req-53dcc261-ff4e-4fa5-9b53-d5fde4fe5ec4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:21.577319 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-3396e76a-000f-4d2b-88e4-c44b1eaf59e1 req-53dcc261-ff4e-4fa5-9b53-d5fde4fe5ec4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:21.578872 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b6804d0d-4b8b-463b-a58f-0368ebd28c3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.170215 Aug 02 08:59:21.579451 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 247/495] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:21 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:21.589438 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-3396e76a-000f-4d2b-88e4-c44b1eaf59e1 req-53dcc261-ff4e-4fa5-9b53-d5fde4fe5ec4 service nova] Creating event network-vif-plugged:37c8c717-c415-4033-831f-a3fe6f63a25e for instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 on hv-cinder-78729 Aug 02 08:59:21.594328 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-3396e76a-000f-4d2b-88e4-c44b1eaf59e1 req-53dcc261-ff4e-4fa5-9b53-d5fde4fe5ec4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098414 Aug 02 08:59:21.594914 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 249/496] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:21.620829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-01dd2538-0e12-4768-b2b5-a952570bacac tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:21.621441 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-01dd2538-0e12-4768-b2b5-a952570bacac tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:21.627496 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01dd2538-0e12-4768-b2b5-a952570bacac tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:21.627944 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01dd2538-0e12-4768-b2b5-a952570bacac tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:21.628752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01dd2538-0e12-4768-b2b5-a952570bacac tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:21.629194 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-01dd2538-0e12-4768-b2b5-a952570bacac tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:21.772170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-01dd2538-0e12-4768-b2b5-a952570bacac tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:21.779589 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-01dd2538-0e12-4768-b2b5-a952570bacac tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1366 microversion: 2.1 time: 0.163569 Aug 02 08:59:21.780174 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 248/497] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:21 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:22.511251 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-bd4e2313-2106-4103-b3e0-f8ced0c11928 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:22.511942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-bd4e2313-2106-4103-b3e0-f8ced0c11928 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:22.518548 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bd4e2313-2106-4103-b3e0-f8ced0c11928 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:22.518989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bd4e2313-2106-4103-b3e0-f8ced0c11928 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:22.519740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bd4e2313-2106-4103-b3e0-f8ced0c11928 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:22.520189 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bd4e2313-2106-4103-b3e0-f8ced0c11928 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:22.602014 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d38ef700-1079-41bd-a40b-53c3f5a41717 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:22.602616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d38ef700-1079-41bd-a40b-53c3f5a41717 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:22.610064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d38ef700-1079-41bd-a40b-53c3f5a41717 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:22.610727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d38ef700-1079-41bd-a40b-53c3f5a41717 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:22.611490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d38ef700-1079-41bd-a40b-53c3f5a41717 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:22.611953 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d38ef700-1079-41bd-a40b-53c3f5a41717 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:22.651793 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-bd4e2313-2106-4103-b3e0-f8ced0c11928 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:22.660257 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-bd4e2313-2106-4103-b3e0-f8ced0c11928 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.153105 Aug 02 08:59:22.660913 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 250/498] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:22 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:22.741112 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d38ef700-1079-41bd-a40b-53c3f5a41717 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:22.748438 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d38ef700-1079-41bd-a40b-53c3f5a41717 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.151741 Aug 02 08:59:22.749003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 249/499] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:22 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:22.800190 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-594ef96a-2e1a-4ca5-8c2d-2094c0051e72 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:22.801068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-594ef96a-2e1a-4ca5-8c2d-2094c0051e72 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:22.807225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-594ef96a-2e1a-4ca5-8c2d-2094c0051e72 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:22.807678 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-594ef96a-2e1a-4ca5-8c2d-2094c0051e72 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:22.808563 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-594ef96a-2e1a-4ca5-8c2d-2094c0051e72 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:22.808943 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-594ef96a-2e1a-4ca5-8c2d-2094c0051e72 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:22.936336 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-594ef96a-2e1a-4ca5-8c2d-2094c0051e72 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:22.943822 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-594ef96a-2e1a-4ca5-8c2d-2094c0051e72 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1366 microversion: 2.1 time: 0.147457 Aug 02 08:59:22.944423 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 251/500] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:22 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:23.681801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f6d5e9d4-98b2-46ce-ae17-d7beefd018f7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:23.682400 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f6d5e9d4-98b2-46ce-ae17-d7beefd018f7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:23.689122 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f6d5e9d4-98b2-46ce-ae17-d7beefd018f7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:23.689572 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f6d5e9d4-98b2-46ce-ae17-d7beefd018f7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:23.690342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f6d5e9d4-98b2-46ce-ae17-d7beefd018f7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:23.690782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f6d5e9d4-98b2-46ce-ae17-d7beefd018f7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:23.770826 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-53bd502d-c6f1-418b-9541-2e923ac1d166 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:23.771804 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-53bd502d-c6f1-418b-9541-2e923ac1d166 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:23.774651 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:23.782319 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-53bd502d-c6f1-418b-9541-2e923ac1d166 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:23.782839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-53bd502d-c6f1-418b-9541-2e923ac1d166 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:23.783682 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-53bd502d-c6f1-418b-9541-2e923ac1d166 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:23.784167 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-53bd502d-c6f1-418b-9541-2e923ac1d166 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:23.825869 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f6d5e9d4-98b2-46ce-ae17-d7beefd018f7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:23.834279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f6d5e9d4-98b2-46ce-ae17-d7beefd018f7 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.156373 Aug 02 08:59:23.834852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 250/501] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:23 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:23.918769 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-53bd502d-c6f1-418b-9541-2e923ac1d166 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:23.926273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-53bd502d-c6f1-418b-9541-2e923ac1d166 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.159981 Aug 02 08:59:23.926830 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 252/502] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:23 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:23.964825 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-16bdf968-33a3-47d6-89f2-c71f8a9ff9b6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:23.965363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-16bdf968-33a3-47d6-89f2-c71f8a9ff9b6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:23.971305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-16bdf968-33a3-47d6-89f2-c71f8a9ff9b6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:23.971753 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-16bdf968-33a3-47d6-89f2-c71f8a9ff9b6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:23.972558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-16bdf968-33a3-47d6-89f2-c71f8a9ff9b6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:23.972998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-16bdf968-33a3-47d6-89f2-c71f8a9ff9b6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:24.100436 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-16bdf968-33a3-47d6-89f2-c71f8a9ff9b6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:24.108419 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-16bdf968-33a3-47d6-89f2-c71f8a9ff9b6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1555 microversion: 2.1 time: 0.147464 Aug 02 08:59:24.108979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 251/503] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:23 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:24.128021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1e03efe9-3bf1-46af-b7b0-c114d7eea453 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:24.128535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1e03efe9-3bf1-46af-b7b0-c114d7eea453 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:24.130344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:24.136071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1e03efe9-3bf1-46af-b7b0-c114d7eea453 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:24.136569 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1e03efe9-3bf1-46af-b7b0-c114d7eea453 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:24.137321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1e03efe9-3bf1-46af-b7b0-c114d7eea453 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:24.137751 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1e03efe9-3bf1-46af-b7b0-c114d7eea453 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:24.151332 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=12 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:24.213819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1e03efe9-3bf1-46af-b7b0-c114d7eea453 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089517 Aug 02 08:59:24.214480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 253/504] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 2 08:59:24 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:24.855800 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6ae7a360-194c-4a30-adf0-4b792325e53b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:24.856444 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6ae7a360-194c-4a30-adf0-4b792325e53b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:24.858396 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=8 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:24.864541 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6ae7a360-194c-4a30-adf0-4b792325e53b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:24.864974 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6ae7a360-194c-4a30-adf0-4b792325e53b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:24.865747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6ae7a360-194c-4a30-adf0-4b792325e53b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:24.866351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6ae7a360-194c-4a30-adf0-4b792325e53b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:24.947884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-413e1a7d-dccd-4b2c-ab46-cc39ff54bfab tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:24.948683 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-413e1a7d-dccd-4b2c-ab46-cc39ff54bfab tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:24.955379 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-413e1a7d-dccd-4b2c-ab46-cc39ff54bfab tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:24.955834 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-413e1a7d-dccd-4b2c-ab46-cc39ff54bfab tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:24.956652 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-413e1a7d-dccd-4b2c-ab46-cc39ff54bfab tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:24.957341 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-413e1a7d-dccd-4b2c-ab46-cc39ff54bfab tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:25.003419 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6ae7a360-194c-4a30-adf0-4b792325e53b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:25.013162 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6ae7a360-194c-4a30-adf0-4b792325e53b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.161726 Aug 02 08:59:25.013751 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 252/505] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:24 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:25.394567 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-413e1a7d-dccd-4b2c-ab46-cc39ff54bfab tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:25.402056 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-413e1a7d-dccd-4b2c-ab46-cc39ff54bfab tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.459075 Aug 02 08:59:25.402627 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 254/506] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:24 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:25.456724 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-fd85e053-368c-4a19-867d-403ffbe37d1e req-85fbf840-ed8c-47b2-a469-4e0fcdbed3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d22468-69c0-45b8-8ee0-0bc6247befa7", "tag": "37c8c717-c415-4033-831f-a3fe6f63a25e"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:25.466411 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-fd85e053-368c-4a19-867d-403ffbe37d1e req-85fbf840-ed8c-47b2-a469-4e0fcdbed3de service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:25.466855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-fd85e053-368c-4a19-867d-403ffbe37d1e req-85fbf840-ed8c-47b2-a469-4e0fcdbed3de service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:25.477758 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-fd85e053-368c-4a19-867d-403ffbe37d1e req-85fbf840-ed8c-47b2-a469-4e0fcdbed3de service nova] Creating event network-changed:37c8c717-c415-4033-831f-a3fe6f63a25e for instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 on hv-cinder-78729 Aug 02 08:59:25.483102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-fd85e053-368c-4a19-867d-403ffbe37d1e req-85fbf840-ed8c-47b2-a469-4e0fcdbed3de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030008 Aug 02 08:59:25.483696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 253/507] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:59:26.035127 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-10ade98e-9170-4186-98c2-6415715a111e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:26.036654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-10ade98e-9170-4186-98c2-6415715a111e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:26.044178 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-10ade98e-9170-4186-98c2-6415715a111e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:26.044635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-10ade98e-9170-4186-98c2-6415715a111e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:26.045449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-10ade98e-9170-4186-98c2-6415715a111e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:26.045890 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-10ade98e-9170-4186-98c2-6415715a111e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:26.196784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-10ade98e-9170-4186-98c2-6415715a111e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:26.204903 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-10ade98e-9170-4186-98c2-6415715a111e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.173664 Aug 02 08:59:26.205457 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 255/508] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:26 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:26.423468 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6315d832-b774-4665-8fe4-ee36f641a772 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:26.424185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6315d832-b774-4665-8fe4-ee36f641a772 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:26.430847 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6315d832-b774-4665-8fe4-ee36f641a772 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:26.431395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6315d832-b774-4665-8fe4-ee36f641a772 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:26.432354 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6315d832-b774-4665-8fe4-ee36f641a772 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:26.432816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6315d832-b774-4665-8fe4-ee36f641a772 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:26.566111 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6315d832-b774-4665-8fe4-ee36f641a772 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:26.574183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6315d832-b774-4665-8fe4-ee36f641a772 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.155066 Aug 02 08:59:26.574777 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 254/509] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:26 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:27.227290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e799f841-b89b-43a4-9942-8d34d33ff101 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:27.227888 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e799f841-b89b-43a4-9942-8d34d33ff101 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:27.234365 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e799f841-b89b-43a4-9942-8d34d33ff101 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:27.234815 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e799f841-b89b-43a4-9942-8d34d33ff101 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:27.235586 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e799f841-b89b-43a4-9942-8d34d33ff101 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:27.236049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e799f841-b89b-43a4-9942-8d34d33ff101 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:27.361939 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e799f841-b89b-43a4-9942-8d34d33ff101 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:27.370505 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e799f841-b89b-43a4-9942-8d34d33ff101 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.147561 Aug 02 08:59:27.371060 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 256/510] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:27 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:27.595688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5207221f-bb90-44dd-9429-81e5afb6641f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:27.596335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5207221f-bb90-44dd-9429-81e5afb6641f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:27.603658 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5207221f-bb90-44dd-9429-81e5afb6641f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:27.604104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5207221f-bb90-44dd-9429-81e5afb6641f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:27.604946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5207221f-bb90-44dd-9429-81e5afb6641f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:27.605388 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5207221f-bb90-44dd-9429-81e5afb6641f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:27.733424 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5207221f-bb90-44dd-9429-81e5afb6641f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:27.740902 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5207221f-bb90-44dd-9429-81e5afb6641f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.148968 Aug 02 08:59:27.741456 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 255/511] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:27 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:28.391263 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9c8f37ce-3f14-4091-9349-88092047bc6a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:28.391858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9c8f37ce-3f14-4091-9349-88092047bc6a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:28.398322 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c8f37ce-3f14-4091-9349-88092047bc6a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:28.398764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c8f37ce-3f14-4091-9349-88092047bc6a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:28.399531 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c8f37ce-3f14-4091-9349-88092047bc6a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:28.399975 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9c8f37ce-3f14-4091-9349-88092047bc6a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:28.526640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-9c8f37ce-3f14-4091-9349-88092047bc6a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:28.534430 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9c8f37ce-3f14-4091-9349-88092047bc6a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.147173 Aug 02 08:59:28.534988 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 257/512] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:28 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:28.761207 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1064609f-b82b-4ff0-a764-004b4fc0bc68 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:28.761820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1064609f-b82b-4ff0-a764-004b4fc0bc68 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:28.768295 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1064609f-b82b-4ff0-a764-004b4fc0bc68 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:28.768751 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1064609f-b82b-4ff0-a764-004b4fc0bc68 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:28.769514 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1064609f-b82b-4ff0-a764-004b4fc0bc68 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:28.769955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1064609f-b82b-4ff0-a764-004b4fc0bc68 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:28.901526 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1064609f-b82b-4ff0-a764-004b4fc0bc68 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:28.909036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1064609f-b82b-4ff0-a764-004b4fc0bc68 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.151713 Aug 02 08:59:28.909603 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 256/513] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:28 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:29.555870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-abc36938-3db2-43f7-afa9-e431f1dad31a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:29.556642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-abc36938-3db2-43f7-afa9-e431f1dad31a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:29.567531 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-abc36938-3db2-43f7-afa9-e431f1dad31a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:29.567981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-abc36938-3db2-43f7-afa9-e431f1dad31a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:29.568793 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-abc36938-3db2-43f7-afa9-e431f1dad31a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:29.569232 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-abc36938-3db2-43f7-afa9-e431f1dad31a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:29.701161 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-abc36938-3db2-43f7-afa9-e431f1dad31a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:29.709311 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-abc36938-3db2-43f7-afa9-e431f1dad31a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.157278 Aug 02 08:59:29.709873 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 258/514] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:29 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:29.931711 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c33391a3-967c-4e14-b27e-2ca30c465b6e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:29.932266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c33391a3-967c-4e14-b27e-2ca30c465b6e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:29.938760 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c33391a3-967c-4e14-b27e-2ca30c465b6e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:29.939203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c33391a3-967c-4e14-b27e-2ca30c465b6e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:29.939986 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c33391a3-967c-4e14-b27e-2ca30c465b6e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:29.940450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c33391a3-967c-4e14-b27e-2ca30c465b6e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:30.071005 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c33391a3-967c-4e14-b27e-2ca30c465b6e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:30.074502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=100 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:30.079265 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c33391a3-967c-4e14-b27e-2ca30c465b6e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.152081 Aug 02 08:59:30.079824 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 257/515] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:29 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:30.731643 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0894c8da-7e02-4cd1-8c7a-8800d30bc84a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:30.732316 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0894c8da-7e02-4cd1-8c7a-8800d30bc84a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:30.738954 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0894c8da-7e02-4cd1-8c7a-8800d30bc84a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:30.739444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0894c8da-7e02-4cd1-8c7a-8800d30bc84a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:30.740184 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0894c8da-7e02-4cd1-8c7a-8800d30bc84a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:30.740624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0894c8da-7e02-4cd1-8c7a-8800d30bc84a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:30.880086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0894c8da-7e02-4cd1-8c7a-8800d30bc84a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:30.888467 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0894c8da-7e02-4cd1-8c7a-8800d30bc84a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.160763 Aug 02 08:59:30.889051 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 259/516] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:30 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:31.100378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2516e17e-1652-4148-b6ad-b9a59f7917ee tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:31.100981 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2516e17e-1652-4148-b6ad-b9a59f7917ee tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:31.103745 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:31.109130 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2516e17e-1652-4148-b6ad-b9a59f7917ee tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:31.109580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2516e17e-1652-4148-b6ad-b9a59f7917ee tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:31.110347 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2516e17e-1652-4148-b6ad-b9a59f7917ee tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:31.110784 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2516e17e-1652-4148-b6ad-b9a59f7917ee tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:31.247818 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2516e17e-1652-4148-b6ad-b9a59f7917ee tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:31.255307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2516e17e-1652-4148-b6ad-b9a59f7917ee tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.158886 Aug 02 08:59:31.255873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 258/517] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:31 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:31.785071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-d8f9b132-896a-4d59-a1ab-7cc41453c09c req-7b578886-a781-406d-9f1b-94613f9807c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3981c8ca-8909-4516-8813-e3a3cd71960b", "name": "network-vif-plugged", "status": "completed", "tag": "4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:31.795753 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-d8f9b132-896a-4d59-a1ab-7cc41453c09c req-7b578886-a781-406d-9f1b-94613f9807c0 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:31.796228 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-d8f9b132-896a-4d59-a1ab-7cc41453c09c req-7b578886-a781-406d-9f1b-94613f9807c0 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:31.808211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-d8f9b132-896a-4d59-a1ab-7cc41453c09c req-7b578886-a781-406d-9f1b-94613f9807c0 service nova] Creating event network-vif-plugged:4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55 for instance 3981c8ca-8909-4516-8813-e3a3cd71960b on hv-cinder-78729 Aug 02 08:59:31.813244 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-d8f9b132-896a-4d59-a1ab-7cc41453c09c req-7b578886-a781-406d-9f1b-94613f9807c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031774 Aug 02 08:59:31.814276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 260/518] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:31.911799 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c8aae24f-4e8f-4f44-a719-5eb9b07351d5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:31.912434 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c8aae24f-4e8f-4f44-a719-5eb9b07351d5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:31.918926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c8aae24f-4e8f-4f44-a719-5eb9b07351d5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:31.919349 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c8aae24f-4e8f-4f44-a719-5eb9b07351d5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:31.920103 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c8aae24f-4e8f-4f44-a719-5eb9b07351d5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:31.920556 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c8aae24f-4e8f-4f44-a719-5eb9b07351d5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:32.050419 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c8aae24f-4e8f-4f44-a719-5eb9b07351d5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:32.059348 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c8aae24f-4e8f-4f44-a719-5eb9b07351d5 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.152574 Aug 02 08:59:32.059936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 259/519] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:31 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:32.276776 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fceaf7c8-7933-4ee2-9e4a-dcb5d33250d6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:32.277417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fceaf7c8-7933-4ee2-9e4a-dcb5d33250d6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:32.283732 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fceaf7c8-7933-4ee2-9e4a-dcb5d33250d6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:32.284218 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fceaf7c8-7933-4ee2-9e4a-dcb5d33250d6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:32.284989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fceaf7c8-7933-4ee2-9e4a-dcb5d33250d6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:32.285433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fceaf7c8-7933-4ee2-9e4a-dcb5d33250d6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:32.420376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fceaf7c8-7933-4ee2-9e4a-dcb5d33250d6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:32.427923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fceaf7c8-7933-4ee2-9e4a-dcb5d33250d6 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.155963 Aug 02 08:59:32.428509 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 261/520] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:32 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:33.079815 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c234feb1-3201-42ea-8a99-cb2bc2175ae4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:33.080405 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c234feb1-3201-42ea-8a99-cb2bc2175ae4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:33.087173 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c234feb1-3201-42ea-8a99-cb2bc2175ae4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:33.087621 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c234feb1-3201-42ea-8a99-cb2bc2175ae4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:33.088415 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c234feb1-3201-42ea-8a99-cb2bc2175ae4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:33.088849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c234feb1-3201-42ea-8a99-cb2bc2175ae4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:33.218174 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c234feb1-3201-42ea-8a99-cb2bc2175ae4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:33.226081 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c234feb1-3201-42ea-8a99-cb2bc2175ae4 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.150241 Aug 02 08:59:33.227224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 260/521] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:33 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:33.449543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b6ba868e-865d-4f26-860d-a7a5cdfe8fe4 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:33.450079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b6ba868e-865d-4f26-860d-a7a5cdfe8fe4 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:33.456898 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b6ba868e-865d-4f26-860d-a7a5cdfe8fe4 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:33.457543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b6ba868e-865d-4f26-860d-a7a5cdfe8fe4 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:33.458334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b6ba868e-865d-4f26-860d-a7a5cdfe8fe4 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:33.458773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b6ba868e-865d-4f26-860d-a7a5cdfe8fe4 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:33.590091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b6ba868e-865d-4f26-860d-a7a5cdfe8fe4 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:33.597587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b6ba868e-865d-4f26-860d-a7a5cdfe8fe4 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1259 microversion: 2.1 time: 0.152041 Aug 02 08:59:33.598150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 262/522] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:33 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:34.247834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-bb1aa931-ab7a-47b7-a22a-204bde9d7bc0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:34.248397 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-bb1aa931-ab7a-47b7-a22a-204bde9d7bc0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:34.254892 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bb1aa931-ab7a-47b7-a22a-204bde9d7bc0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:34.255696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bb1aa931-ab7a-47b7-a22a-204bde9d7bc0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:34.256535 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bb1aa931-ab7a-47b7-a22a-204bde9d7bc0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:34.256978 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bb1aa931-ab7a-47b7-a22a-204bde9d7bc0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:34.386227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-bb1aa931-ab7a-47b7-a22a-204bde9d7bc0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:34.394138 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-bb1aa931-ab7a-47b7-a22a-204bde9d7bc0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.150246 Aug 02 08:59:34.394718 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 261/523] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:34 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:34.619480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d6107f8f-fa18-4d83-91ea-a29c88fd363e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:34.620068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d6107f8f-fa18-4d83-91ea-a29c88fd363e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:34.626624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d6107f8f-fa18-4d83-91ea-a29c88fd363e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:34.627065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d6107f8f-fa18-4d83-91ea-a29c88fd363e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:34.627828 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d6107f8f-fa18-4d83-91ea-a29c88fd363e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:34.628288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d6107f8f-fa18-4d83-91ea-a29c88fd363e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:34.763010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d6107f8f-fa18-4d83-91ea-a29c88fd363e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:34.770496 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d6107f8f-fa18-4d83-91ea-a29c88fd363e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1442 microversion: 2.1 time: 0.155572 Aug 02 08:59:34.771056 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 263/524] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:34 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:34.791202 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9b2567ee-a66a-44cb-b00e-c96d72f902fe tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:34.791816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9b2567ee-a66a-44cb-b00e-c96d72f902fe tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:34.798012 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9b2567ee-a66a-44cb-b00e-c96d72f902fe tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:34.798469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9b2567ee-a66a-44cb-b00e-c96d72f902fe tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:34.799230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9b2567ee-a66a-44cb-b00e-c96d72f902fe tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:34.799667 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9b2567ee-a66a-44cb-b00e-c96d72f902fe tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:34.927716 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9b2567ee-a66a-44cb-b00e-c96d72f902fe tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:34.935860 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9b2567ee-a66a-44cb-b00e-c96d72f902fe tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1442 microversion: 2.1 time: 0.149336 Aug 02 08:59:34.936466 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 262/525] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:34 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:35.416490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c91d34fa-eeb9-497e-ac69-cf6179c6fd5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:35.417096 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c91d34fa-eeb9-497e-ac69-cf6179c6fd5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:35.423008 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c91d34fa-eeb9-497e-ac69-cf6179c6fd5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:35.423453 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c91d34fa-eeb9-497e-ac69-cf6179c6fd5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:35.424243 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c91d34fa-eeb9-497e-ac69-cf6179c6fd5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:35.424679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c91d34fa-eeb9-497e-ac69-cf6179c6fd5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:35.654000 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c91d34fa-eeb9-497e-ac69-cf6179c6fd5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:35.662044 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c91d34fa-eeb9-497e-ac69-cf6179c6fd5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.250234 Aug 02 08:59:35.662701 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 264/526] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:35 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:36.635050 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-59e9f30f-5f39-4b48-9900-f70d78ac5cb6 req-8ef06938-f5b5-48f0-9482-42b54bd2b65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3981c8ca-8909-4516-8813-e3a3cd71960b", "tag": "4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:36.644353 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-59e9f30f-5f39-4b48-9900-f70d78ac5cb6 req-8ef06938-f5b5-48f0-9482-42b54bd2b65d service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:36.644792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-59e9f30f-5f39-4b48-9900-f70d78ac5cb6 req-8ef06938-f5b5-48f0-9482-42b54bd2b65d service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:36.656668 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-59e9f30f-5f39-4b48-9900-f70d78ac5cb6 req-8ef06938-f5b5-48f0-9482-42b54bd2b65d service nova] Creating event network-changed:4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55 for instance 3981c8ca-8909-4516-8813-e3a3cd71960b on hv-cinder-78729 Aug 02 08:59:36.661510 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-59e9f30f-5f39-4b48-9900-f70d78ac5cb6 req-8ef06938-f5b5-48f0-9482-42b54bd2b65d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030675 Aug 02 08:59:36.662096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 263/527] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:36.682877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-df30edb8-3f34-453f-a59d-ff89bb8bcf9a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:36.683494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-df30edb8-3f34-453f-a59d-ff89bb8bcf9a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:36.690088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df30edb8-3f34-453f-a59d-ff89bb8bcf9a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:36.690548 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df30edb8-3f34-453f-a59d-ff89bb8bcf9a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:36.691322 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df30edb8-3f34-453f-a59d-ff89bb8bcf9a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:36.691763 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df30edb8-3f34-453f-a59d-ff89bb8bcf9a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:36.710195 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=100 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:36.840341 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-df30edb8-3f34-453f-a59d-ff89bb8bcf9a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:36.849310 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-df30edb8-3f34-453f-a59d-ff89bb8bcf9a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.170364 Aug 02 08:59:36.849881 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 265/528] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:36 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:37.873512 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-75833bd8-2d57-4688-a15c-72907f4c05fa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:37.874220 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-75833bd8-2d57-4688-a15c-72907f4c05fa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:37.880404 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75833bd8-2d57-4688-a15c-72907f4c05fa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:37.880853 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75833bd8-2d57-4688-a15c-72907f4c05fa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:37.881608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75833bd8-2d57-4688-a15c-72907f4c05fa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:37.882045 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75833bd8-2d57-4688-a15c-72907f4c05fa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:38.009230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-75833bd8-2d57-4688-a15c-72907f4c05fa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:38.017091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-75833bd8-2d57-4688-a15c-72907f4c05fa tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.148388 Aug 02 08:59:38.017650 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 264/529] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:37 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:39.037683 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1a213266-54c4-4ab0-a61f-4d706b9ead8b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:39.038209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1a213266-54c4-4ab0-a61f-4d706b9ead8b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:39.044527 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1a213266-54c4-4ab0-a61f-4d706b9ead8b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:39.044969 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1a213266-54c4-4ab0-a61f-4d706b9ead8b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:39.045721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1a213266-54c4-4ab0-a61f-4d706b9ead8b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:39.046150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1a213266-54c4-4ab0-a61f-4d706b9ead8b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:39.175068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1a213266-54c4-4ab0-a61f-4d706b9ead8b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:39.183405 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1a213266-54c4-4ab0-a61f-4d706b9ead8b tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1735 microversion: 2.1 time: 0.149638 Aug 02 08:59:39.183968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 266/530] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:39 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:40.205832 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9bc978c2-4400-4600-ba66-66ae8323aed2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:40.206425 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9bc978c2-4400-4600-ba66-66ae8323aed2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:40.213748 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9bc978c2-4400-4600-ba66-66ae8323aed2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:40.214201 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9bc978c2-4400-4600-ba66-66ae8323aed2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:40.214977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9bc978c2-4400-4600-ba66-66ae8323aed2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:40.215416 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9bc978c2-4400-4600-ba66-66ae8323aed2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:40.347141 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9bc978c2-4400-4600-ba66-66ae8323aed2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:40.354960 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9bc978c2-4400-4600-ba66-66ae8323aed2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1715 microversion: 2.1 time: 0.153001 Aug 02 08:59:40.355523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 265/531] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:40 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:40.414429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:40.414915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:40.421301 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:40.421745 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:40.422495 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:40.422922 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:40.549844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] HTTP exception thrown: Cannot 'detach_volume' instance f003d009-ff7f-402b-8909-26d0e4ed705a while it is in vm_state rescued Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Request method failure captured: Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: DELETE /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments/68d49724-3a61-477d-8bd5-accea83b65e0 HTTP/1.1 Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYZjNzYbJ5mBqiE2yw1T0csKVjkN2yeNeBhK5jIkJf5Xit2MLjbd0yqZmm99CJaCh5ZZdqFbBlu92hhdlw-EYz45f_0D2SOxrdE-bMHcZ779szT2Jp0xIviqccPasp-mq_6P3R4IDJb3Df1HoMqvay8wfKTym7FTWpIoNgdlwBZpl4 Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 08:59:40.551369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4c886ec53c84d5d9542ab7dbbdfcf8b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}] Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 7ed1be3a1ae249828caa8b88fd606557 Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 08:59:40.552752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Cannot 'detach_volume' instance f003d009-ff7f-402b-8909-26d0e4ed705a while it is in vm_state rescued Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'server_id': 'f003d009-ff7f-402b-8909-26d0e4ed705a', 'id': '68d49724-3a61-477d-8bd5-accea83b65e0'} Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f003d009-ff7f-402b-8909-26d0e4ed705a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:59:40.553512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f003d009-ff7f-402b-8909-26d0e4ed705a while it is in vm_state rescued Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f003d009-ff7f-402b-8909-26d0e4ed705a while it is in vm_state rescued Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 08:59:40.554963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Returning 409 to user: Cannot 'detach_volume' instance f003d009-ff7f-402b-8909-26d0e4ed705a while it is in vm_state rescued {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:59:40.557401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c91d1278-b235-4a2b-a5db-767acb64f548 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments/68d49724-3a61-477d-8bd5-accea83b65e0" status: 409 len: 152 microversion: 2.1 time: 0.142321 Aug 02 08:59:40.557401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 267/532] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 08:59:40 2022] DELETE /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments/68d49724-3a61-477d-8bd5-accea83b65e0 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 08:59:40.562759 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-95f87015-d2e5-4bb9-9295-336076915918 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:40.563286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-95f87015-d2e5-4bb9-9295-336076915918 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:40.569547 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-95f87015-d2e5-4bb9-9295-336076915918 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:40.569988 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-95f87015-d2e5-4bb9-9295-336076915918 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:40.570747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-95f87015-d2e5-4bb9-9295-336076915918 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:40.571951 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-95f87015-d2e5-4bb9-9295-336076915918 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:40.639187 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-95f87015-d2e5-4bb9-9295-336076915918 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "POST /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/action" status: 202 len: 0 microversion: 2.1 time: 0.080144 Aug 02 08:59:40.642856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 266/533] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 08:59:40 2022] POST /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 08:59:40.648193 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-21ae561e-0611-458b-ba99-4baedf57ffc2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:40.649746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-21ae561e-0611-458b-ba99-4baedf57ffc2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:40.656471 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21ae561e-0611-458b-ba99-4baedf57ffc2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:40.657003 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21ae561e-0611-458b-ba99-4baedf57ffc2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:40.657877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21ae561e-0611-458b-ba99-4baedf57ffc2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:40.658366 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-21ae561e-0611-458b-ba99-4baedf57ffc2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:40.791609 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-21ae561e-0611-458b-ba99-4baedf57ffc2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:40.799541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-21ae561e-0611-458b-ba99-4baedf57ffc2 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1723 microversion: 2.1 time: 0.155354 Aug 02 08:59:40.800176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 268/534] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:40 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:41.822988 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-be60de2f-60ae-4ad3-82c5-6205a3c5c149 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:41.823605 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-be60de2f-60ae-4ad3-82c5-6205a3c5c149 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:41.829802 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be60de2f-60ae-4ad3-82c5-6205a3c5c149 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:41.830237 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be60de2f-60ae-4ad3-82c5-6205a3c5c149 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:41.830992 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be60de2f-60ae-4ad3-82c5-6205a3c5c149 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:41.831417 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be60de2f-60ae-4ad3-82c5-6205a3c5c149 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:41.960067 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-be60de2f-60ae-4ad3-82c5-6205a3c5c149 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:41.967951 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-be60de2f-60ae-4ad3-82c5-6205a3c5c149 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1723 microversion: 2.1 time: 0.150393 Aug 02 08:59:41.968544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 267/535] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:41 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:42.155307 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-be7425ee-6d65-43c2-bb97-6def9762c01f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:42.155850 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-be7425ee-6d65-43c2-bb97-6def9762c01f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:42.161953 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-be7425ee-6d65-43c2-bb97-6def9762c01f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:42.162401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-be7425ee-6d65-43c2-bb97-6def9762c01f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:42.163164 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-be7425ee-6d65-43c2-bb97-6def9762c01f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:42.163602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-be7425ee-6d65-43c2-bb97-6def9762c01f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:42.244641 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-be7425ee-6d65-43c2-bb97-6def9762c01f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lazy-loading 'services' on Instance uuid a92713a6-b49a-4dd4-b944-0d370dd4326d {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:59:42.355141 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-be7425ee-6d65-43c2-bb97-6def9762c01f tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/os-volume_attachments/bd156143-c219-4b60-9ce7-2bea47d6abe2" status: 202 len: 0 microversion: 2.1 time: 0.301005 Aug 02 08:59:42.355745 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 269/536] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 08:59:42 2022] DELETE /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/os-volume_attachments/bd156143-c219-4b60-9ce7-2bea47d6abe2 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:59:42.988970 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b3e8de5a-b6c6-49a9-b808-b179749ce277 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:42.989581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b3e8de5a-b6c6-49a9-b808-b179749ce277 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:42.996111 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b3e8de5a-b6c6-49a9-b808-b179749ce277 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:42.996600 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b3e8de5a-b6c6-49a9-b808-b179749ce277 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:42.997363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b3e8de5a-b6c6-49a9-b808-b179749ce277 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:42.997802 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b3e8de5a-b6c6-49a9-b808-b179749ce277 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:43.129143 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b3e8de5a-b6c6-49a9-b808-b179749ce277 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:43.137471 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b3e8de5a-b6c6-49a9-b808-b179749ce277 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1723 microversion: 2.1 time: 0.152372 Aug 02 08:59:43.138038 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 268/537] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:42 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:44.159482 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-82aed889-09af-4d9e-a313-0e74531cce06 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:44.160207 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-82aed889-09af-4d9e-a313-0e74531cce06 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:44.167714 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-82aed889-09af-4d9e-a313-0e74531cce06 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:44.168203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-82aed889-09af-4d9e-a313-0e74531cce06 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:44.168995 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-82aed889-09af-4d9e-a313-0e74531cce06 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:44.169436 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-82aed889-09af-4d9e-a313-0e74531cce06 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:44.297448 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-82aed889-09af-4d9e-a313-0e74531cce06 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:44.305281 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-82aed889-09af-4d9e-a313-0e74531cce06 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1723 microversion: 2.1 time: 0.150077 Aug 02 08:59:44.305815 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 270/538] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:44 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:45.327903 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-79921ec5-c320-4986-9833-03d6a39c2765 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:45.328656 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-79921ec5-c320-4986-9833-03d6a39c2765 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:45.335923 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-79921ec5-c320-4986-9833-03d6a39c2765 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:45.336414 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-79921ec5-c320-4986-9833-03d6a39c2765 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:45.337234 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-79921ec5-c320-4986-9833-03d6a39c2765 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:45.337663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-79921ec5-c320-4986-9833-03d6a39c2765 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:45.467464 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-79921ec5-c320-4986-9833-03d6a39c2765 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:45.475765 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-79921ec5-c320-4986-9833-03d6a39c2765 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1729 microversion: 2.1 time: 0.151754 Aug 02 08:59:45.476370 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 269/539] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:45 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:45.496910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f08ab280-b82e-4f53-a8eb-a8938f7154b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:45.497401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f08ab280-b82e-4f53-a8eb-a8938f7154b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:45.503945 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f08ab280-b82e-4f53-a8eb-a8938f7154b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:45.504430 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f08ab280-b82e-4f53-a8eb-a8938f7154b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:45.505198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f08ab280-b82e-4f53-a8eb-a8938f7154b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:45.505635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f08ab280-b82e-4f53-a8eb-a8938f7154b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:45.586125 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f08ab280-b82e-4f53-a8eb-a8938f7154b9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093689 Aug 02 08:59:45.587234 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 271/540] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 2 08:59:45 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:46.471609 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-ffb658f9-dbf5-462a-98a9-1e4ce89406dd req-be59d84f-d40e-4ba2-a770-7332fda3cb62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f003d009-ff7f-402b-8909-26d0e4ed705a", "tag": "5a62ab27-1e19-43ae-907f-3e801613a1ff"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:46.482413 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-ffb658f9-dbf5-462a-98a9-1e4ce89406dd req-be59d84f-d40e-4ba2-a770-7332fda3cb62 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:46.482857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-ffb658f9-dbf5-462a-98a9-1e4ce89406dd req-be59d84f-d40e-4ba2-a770-7332fda3cb62 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:46.496886 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-ffb658f9-dbf5-462a-98a9-1e4ce89406dd req-be59d84f-d40e-4ba2-a770-7332fda3cb62 service nova] Creating event network-changed:5a62ab27-1e19-43ae-907f-3e801613a1ff for instance f003d009-ff7f-402b-8909-26d0e4ed705a on hv-cinder-78729 Aug 02 08:59:46.503932 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-ffb658f9-dbf5-462a-98a9-1e4ce89406dd req-be59d84f-d40e-4ba2-a770-7332fda3cb62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036016 Aug 02 08:59:46.505659 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 270/541] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:46.656720 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c0571ce7-27b9-4329-807f-d1d6e8d33bcb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:46.666600 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c0571ce7-27b9-4329-807f-d1d6e8d33bcb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:46.667253 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c0571ce7-27b9-4329-807f-d1d6e8d33bcb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:46.692739 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c0571ce7-27b9-4329-807f-d1d6e8d33bcb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Going to try to stop instance {{(pid=117773) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 08:59:46.739832 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c0571ce7-27b9-4329-807f-d1d6e8d33bcb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/action" status: 202 len: 0 microversion: 2.1 time: 0.087374 Aug 02 08:59:46.745320 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 272/542] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 08:59:46 2022] POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:59:46.751453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-264b0d84-6b4d-4f6b-8293-c6d58d4e1852 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:46.752527 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-264b0d84-6b4d-4f6b-8293-c6d58d4e1852 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:46.761158 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-264b0d84-6b4d-4f6b-8293-c6d58d4e1852 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:46.762097 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-264b0d84-6b4d-4f6b-8293-c6d58d4e1852 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:46.763005 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-264b0d84-6b4d-4f6b-8293-c6d58d4e1852 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:46.763548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-264b0d84-6b4d-4f6b-8293-c6d58d4e1852 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:46.900777 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-264b0d84-6b4d-4f6b-8293-c6d58d4e1852 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:46.908546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-264b0d84-6b4d-4f6b-8293-c6d58d4e1852 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.162130 Aug 02 08:59:46.912161 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 271/543] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:46 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:47.930947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-eada687d-5ef8-4f2b-b577-dfa9ba73ae7a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:47.931657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-eada687d-5ef8-4f2b-b577-dfa9ba73ae7a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:47.938304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eada687d-5ef8-4f2b-b577-dfa9ba73ae7a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:47.938751 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eada687d-5ef8-4f2b-b577-dfa9ba73ae7a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:47.939625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eada687d-5ef8-4f2b-b577-dfa9ba73ae7a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:47.940065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eada687d-5ef8-4f2b-b577-dfa9ba73ae7a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:48.067709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-eada687d-5ef8-4f2b-b577-dfa9ba73ae7a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:48.075816 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-eada687d-5ef8-4f2b-b577-dfa9ba73ae7a tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.149516 Aug 02 08:59:48.076423 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 273/544] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:47 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:48.518948 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-6c706a34-c8b0-48fb-b235-eeb424dd672d req-923c8a5f-877e-4634-8e2d-8be1b4098c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f003d009-ff7f-402b-8909-26d0e4ed705a", "tag": "5a62ab27-1e19-43ae-907f-3e801613a1ff"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:48.529423 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6c706a34-c8b0-48fb-b235-eeb424dd672d req-923c8a5f-877e-4634-8e2d-8be1b4098c41 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:48.529861 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6c706a34-c8b0-48fb-b235-eeb424dd672d req-923c8a5f-877e-4634-8e2d-8be1b4098c41 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:48.540974 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-6c706a34-c8b0-48fb-b235-eeb424dd672d req-923c8a5f-877e-4634-8e2d-8be1b4098c41 service nova] Creating event network-changed:5a62ab27-1e19-43ae-907f-3e801613a1ff for instance f003d009-ff7f-402b-8909-26d0e4ed705a on hv-cinder-78729 Aug 02 08:59:48.546618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-6c706a34-c8b0-48fb-b235-eeb424dd672d req-923c8a5f-877e-4634-8e2d-8be1b4098c41 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031297 Aug 02 08:59:48.547210 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 272/545] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 08:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:49.098223 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-14d24791-b959-45de-b115-d34694aef170 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:49.099481 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-14d24791-b959-45de-b115-d34694aef170 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:49.106102 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-14d24791-b959-45de-b115-d34694aef170 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:49.106544 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-14d24791-b959-45de-b115-d34694aef170 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:49.107313 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-14d24791-b959-45de-b115-d34694aef170 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:49.107745 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-14d24791-b959-45de-b115-d34694aef170 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:49.244198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-14d24791-b959-45de-b115-d34694aef170 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:49.252247 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-14d24791-b959-45de-b115-d34694aef170 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.157928 Aug 02 08:59:49.252818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 274/546] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:49 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:50.273789 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a9d8fc26-ca94-4400-bd1a-1773f77739a8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:50.275056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a9d8fc26-ca94-4400-bd1a-1773f77739a8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:50.281804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a9d8fc26-ca94-4400-bd1a-1773f77739a8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:50.282254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a9d8fc26-ca94-4400-bd1a-1773f77739a8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:50.283017 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a9d8fc26-ca94-4400-bd1a-1773f77739a8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:50.283454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a9d8fc26-ca94-4400-bd1a-1773f77739a8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:50.414303 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a9d8fc26-ca94-4400-bd1a-1773f77739a8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:50.422443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a9d8fc26-ca94-4400-bd1a-1773f77739a8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.152831 Aug 02 08:59:50.422951 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 273/547] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:50 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:51.443541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7a4b99ef-bd84-4825-acff-49c8fb9bfa72 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:51.444180 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7a4b99ef-bd84-4825-acff-49c8fb9bfa72 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:51.451168 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a4b99ef-bd84-4825-acff-49c8fb9bfa72 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:51.451621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a4b99ef-bd84-4825-acff-49c8fb9bfa72 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:51.452416 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a4b99ef-bd84-4825-acff-49c8fb9bfa72 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:51.452858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a4b99ef-bd84-4825-acff-49c8fb9bfa72 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:51.579848 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7a4b99ef-bd84-4825-acff-49c8fb9bfa72 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:51.587540 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7a4b99ef-bd84-4825-acff-49c8fb9bfa72 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.147902 Aug 02 08:59:51.588102 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 275/548] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:51 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:52.609684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c0c3de68-9307-474e-98ed-a14e938e7077 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:52.610305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c0c3de68-9307-474e-98ed-a14e938e7077 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:52.617556 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0c3de68-9307-474e-98ed-a14e938e7077 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:52.618047 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0c3de68-9307-474e-98ed-a14e938e7077 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:52.618812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0c3de68-9307-474e-98ed-a14e938e7077 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:52.619241 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c0c3de68-9307-474e-98ed-a14e938e7077 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:52.753659 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c0c3de68-9307-474e-98ed-a14e938e7077 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:52.761617 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c0c3de68-9307-474e-98ed-a14e938e7077 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.156246 Aug 02 08:59:52.762185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 274/549] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:52 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:59:53.783012 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-971907d4-f652-4602-ae67-3e93f2ea0b3d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:53.783545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-971907d4-f652-4602-ae67-3e93f2ea0b3d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:53.790527 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-971907d4-f652-4602-ae67-3e93f2ea0b3d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:53.790974 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-971907d4-f652-4602-ae67-3e93f2ea0b3d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:53.791731 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-971907d4-f652-4602-ae67-3e93f2ea0b3d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:53.792190 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-971907d4-f652-4602-ae67-3e93f2ea0b3d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:53.923069 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-971907d4-f652-4602-ae67-3e93f2ea0b3d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:53.930547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-971907d4-f652-4602-ae67-3e93f2ea0b3d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.151429 Aug 02 08:59:53.931163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 276/550] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:53 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:54.952294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ceb1cd0f-cefc-49a1-8d18-8943da6cb8ad tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:54.952896 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ceb1cd0f-cefc-49a1-8d18-8943da6cb8ad tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:54.959555 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ceb1cd0f-cefc-49a1-8d18-8943da6cb8ad tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:54.959997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ceb1cd0f-cefc-49a1-8d18-8943da6cb8ad tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:54.960881 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ceb1cd0f-cefc-49a1-8d18-8943da6cb8ad tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:54.961313 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ceb1cd0f-cefc-49a1-8d18-8943da6cb8ad tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:54.979501 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:55.093445 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ceb1cd0f-cefc-49a1-8d18-8943da6cb8ad tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:55.100894 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ceb1cd0f-cefc-49a1-8d18-8943da6cb8ad tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.152530 Aug 02 08:59:55.101456 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 275/551] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:54 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:56.122308 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3a0b8bf5-7c77-4559-84a7-c6c7d20a842e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:56.122912 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3a0b8bf5-7c77-4559-84a7-c6c7d20a842e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:56.125709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=50 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:56.131445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3a0b8bf5-7c77-4559-84a7-c6c7d20a842e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:56.131893 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3a0b8bf5-7c77-4559-84a7-c6c7d20a842e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:56.132691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3a0b8bf5-7c77-4559-84a7-c6c7d20a842e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:56.133126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3a0b8bf5-7c77-4559-84a7-c6c7d20a842e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:56.259531 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3a0b8bf5-7c77-4559-84a7-c6c7d20a842e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:56.266927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3a0b8bf5-7c77-4559-84a7-c6c7d20a842e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.148481 Aug 02 08:59:56.267484 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 277/552] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:56 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:57.288757 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-054ffca1-24cf-4be6-9034-16a2cdec6a57 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:57.289394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-054ffca1-24cf-4be6-9034-16a2cdec6a57 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:57.296543 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-054ffca1-24cf-4be6-9034-16a2cdec6a57 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:57.296994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-054ffca1-24cf-4be6-9034-16a2cdec6a57 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:57.297761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-054ffca1-24cf-4be6-9034-16a2cdec6a57 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:57.298195 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-054ffca1-24cf-4be6-9034-16a2cdec6a57 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:57.433832 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-054ffca1-24cf-4be6-9034-16a2cdec6a57 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:57.441632 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-054ffca1-24cf-4be6-9034-16a2cdec6a57 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.156745 Aug 02 08:59:57.442200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 276/553] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:57 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:58.463571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-171bc43c-4975-4a3a-9077-699ceab61e01 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:58.464091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-171bc43c-4975-4a3a-9077-699ceab61e01 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:58.470651 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-171bc43c-4975-4a3a-9077-699ceab61e01 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:58.471102 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-171bc43c-4975-4a3a-9077-699ceab61e01 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:58.471868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-171bc43c-4975-4a3a-9077-699ceab61e01 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:58.472351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-171bc43c-4975-4a3a-9077-699ceab61e01 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:58.599542 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-171bc43c-4975-4a3a-9077-699ceab61e01 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:58.607000 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-171bc43c-4975-4a3a-9077-699ceab61e01 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.147498 Aug 02 08:59:58.607564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 278/554] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:58 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:59.628557 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d98c8419-80db-419e-8436-bea48bd99e5e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:59.629086 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d98c8419-80db-419e-8436-bea48bd99e5e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:59:59.636146 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d98c8419-80db-419e-8436-bea48bd99e5e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:59.636605 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d98c8419-80db-419e-8436-bea48bd99e5e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:59.637371 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d98c8419-80db-419e-8436-bea48bd99e5e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:59:59.637810 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d98c8419-80db-419e-8436-bea48bd99e5e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:59:59.768902 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d98c8419-80db-419e-8436-bea48bd99e5e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:59:59.776933 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d98c8419-80db-419e-8436-bea48bd99e5e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.152312 Aug 02 08:59:59.777499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 277/555] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 08:59:59 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:00.797910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-58ab05aa-7236-45dd-b61b-96ac96fa2b68 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:00.798533 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-58ab05aa-7236-45dd-b61b-96ac96fa2b68 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:00.806052 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-58ab05aa-7236-45dd-b61b-96ac96fa2b68 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:00.806534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-58ab05aa-7236-45dd-b61b-96ac96fa2b68 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:00.807492 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-58ab05aa-7236-45dd-b61b-96ac96fa2b68 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:00.807944 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-58ab05aa-7236-45dd-b61b-96ac96fa2b68 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:00.940350 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-58ab05aa-7236-45dd-b61b-96ac96fa2b68 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:00.948236 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-58ab05aa-7236-45dd-b61b-96ac96fa2b68 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.154141 Aug 02 09:00:00.948794 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 279/556] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:00 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:01.970141 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-042523d5-56ae-479b-9c64-16d123c97d44 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:01.970767 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-042523d5-56ae-479b-9c64-16d123c97d44 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:01.973057 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=40 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:01.978796 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-042523d5-56ae-479b-9c64-16d123c97d44 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:01.979239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-042523d5-56ae-479b-9c64-16d123c97d44 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:01.979993 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-042523d5-56ae-479b-9c64-16d123c97d44 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:01.980453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-042523d5-56ae-479b-9c64-16d123c97d44 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:02.107611 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-042523d5-56ae-479b-9c64-16d123c97d44 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:02.115040 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-042523d5-56ae-479b-9c64-16d123c97d44 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.148762 Aug 02 09:00:02.115719 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 278/557] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:01 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:03.136850 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ba67602d-ffd3-4285-8b02-f029ac89b3bb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:03.137408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ba67602d-ffd3-4285-8b02-f029ac89b3bb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:03.143770 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ba67602d-ffd3-4285-8b02-f029ac89b3bb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:03.144241 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ba67602d-ffd3-4285-8b02-f029ac89b3bb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:03.145006 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ba67602d-ffd3-4285-8b02-f029ac89b3bb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:03.145449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ba67602d-ffd3-4285-8b02-f029ac89b3bb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:03.271778 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ba67602d-ffd3-4285-8b02-f029ac89b3bb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:03.275218 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:03.280205 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ba67602d-ffd3-4285-8b02-f029ac89b3bb tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.147945 Aug 02 09:00:03.280771 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 280/558] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:03 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:04.301970 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5484b4b8-defc-48f2-a19d-5433678f838c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:04.302582 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5484b4b8-defc-48f2-a19d-5433678f838c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:04.309678 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5484b4b8-defc-48f2-a19d-5433678f838c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:04.310131 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5484b4b8-defc-48f2-a19d-5433678f838c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:04.310902 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5484b4b8-defc-48f2-a19d-5433678f838c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:04.311347 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5484b4b8-defc-48f2-a19d-5433678f838c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:04.442117 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5484b4b8-defc-48f2-a19d-5433678f838c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:04.450294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5484b4b8-defc-48f2-a19d-5433678f838c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.152218 Aug 02 09:00:04.450861 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 279/559] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:04 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:05.470810 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-92f84a91-749e-40de-baf7-09d423ebf33e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:05.471413 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-92f84a91-749e-40de-baf7-09d423ebf33e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:05.479385 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-92f84a91-749e-40de-baf7-09d423ebf33e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:05.479818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-92f84a91-749e-40de-baf7-09d423ebf33e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:05.480611 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-92f84a91-749e-40de-baf7-09d423ebf33e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:05.481043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-92f84a91-749e-40de-baf7-09d423ebf33e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:05.614470 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-92f84a91-749e-40de-baf7-09d423ebf33e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:05.621885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-92f84a91-749e-40de-baf7-09d423ebf33e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.154928 Aug 02 09:00:05.622434 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 281/560] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:05 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:06.642780 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-221909bf-783f-473f-846e-0252cb8a7869 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:06.643389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-221909bf-783f-473f-846e-0252cb8a7869 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:06.650002 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-221909bf-783f-473f-846e-0252cb8a7869 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:06.650495 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-221909bf-783f-473f-846e-0252cb8a7869 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:06.651258 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-221909bf-783f-473f-846e-0252cb8a7869 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:06.651694 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-221909bf-783f-473f-846e-0252cb8a7869 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:06.782578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-221909bf-783f-473f-846e-0252cb8a7869 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:06.790030 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-221909bf-783f-473f-846e-0252cb8a7869 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1677 microversion: 2.1 time: 0.151073 Aug 02 09:00:06.790594 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 280/561] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:06 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:07.810959 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cebc4c19-663a-4716-bc85-75cf271ea11e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:07.811654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-cebc4c19-663a-4716-bc85-75cf271ea11e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:07.818351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cebc4c19-663a-4716-bc85-75cf271ea11e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:07.818800 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cebc4c19-663a-4716-bc85-75cf271ea11e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:07.819572 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cebc4c19-663a-4716-bc85-75cf271ea11e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:07.820010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cebc4c19-663a-4716-bc85-75cf271ea11e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:07.947043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-cebc4c19-663a-4716-bc85-75cf271ea11e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:07.955007 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-cebc4c19-663a-4716-bc85-75cf271ea11e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1654 microversion: 2.1 time: 0.147903 Aug 02 09:00:07.955571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 282/562] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:07 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:07.976369 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-cea793d2-f517-4ab2-81e5-3d69d5ac48dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:00:07.982976 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cea793d2-f517-4ab2-81e5-3d69d5ac48dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:07.983419 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cea793d2-f517-4ab2-81e5-3d69d5ac48dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:08.005156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-cea793d2-f517-4ab2-81e5-3d69d5ac48dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Going to try to start instance {{(pid=117772) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 09:00:08.052291 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-cea793d2-f517-4ab2-81e5-3d69d5ac48dc tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/action" status: 202 len: 0 microversion: 2.1 time: 0.079527 Aug 02 09:00:08.052894 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 281/563] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 09:00:07 2022] POST /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:00:08.063846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d898ad54-1891-4c11-81d7-a618c2919692 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:08.064146 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d898ad54-1891-4c11-81d7-a618c2919692 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:08.070386 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d898ad54-1891-4c11-81d7-a618c2919692 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:08.070839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d898ad54-1891-4c11-81d7-a618c2919692 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:08.080252 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d898ad54-1891-4c11-81d7-a618c2919692 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:08.080702 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d898ad54-1891-4c11-81d7-a618c2919692 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:08.223567 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d898ad54-1891-4c11-81d7-a618c2919692 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:08.230936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d898ad54-1891-4c11-81d7-a618c2919692 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1663 microversion: 2.1 time: 0.172664 Aug 02 09:00:08.231544 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 283/564] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:08 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:09.253677 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-deee54e0-9c12-4fd0-9d9f-2d84990d2eba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:09.254396 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-deee54e0-9c12-4fd0-9d9f-2d84990d2eba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:09.260574 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-deee54e0-9c12-4fd0-9d9f-2d84990d2eba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:09.261003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-deee54e0-9c12-4fd0-9d9f-2d84990d2eba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:09.261787 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-deee54e0-9c12-4fd0-9d9f-2d84990d2eba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:09.262217 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-deee54e0-9c12-4fd0-9d9f-2d84990d2eba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:09.400090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-deee54e0-9c12-4fd0-9d9f-2d84990d2eba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:09.407608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-deee54e0-9c12-4fd0-9d9f-2d84990d2eba tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1663 microversion: 2.1 time: 0.158605 Aug 02 09:00:09.408184 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 282/565] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:09 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:10.429123 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a9237158-be93-4d0d-8919-617fb576dfe8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:10.429736 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a9237158-be93-4d0d-8919-617fb576dfe8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:10.435845 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a9237158-be93-4d0d-8919-617fb576dfe8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:10.436338 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a9237158-be93-4d0d-8919-617fb576dfe8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:10.437123 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a9237158-be93-4d0d-8919-617fb576dfe8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:10.437566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a9237158-be93-4d0d-8919-617fb576dfe8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:10.567859 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a9237158-be93-4d0d-8919-617fb576dfe8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:10.575449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a9237158-be93-4d0d-8919-617fb576dfe8 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1667 microversion: 2.1 time: 0.150293 Aug 02 09:00:10.576008 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 284/566] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:10 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:31.224074 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-62944685-da75-4a82-8e71-a77d2dea2f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:31.224683 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-62944685-da75-4a82-8e71-a77d2dea2f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:31.226707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=9 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:31.227362 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:31.233726 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62944685-da75-4a82-8e71-a77d2dea2f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:31.234175 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62944685-da75-4a82-8e71-a77d2dea2f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:31.234940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62944685-da75-4a82-8e71-a77d2dea2f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:31.235374 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62944685-da75-4a82-8e71-a77d2dea2f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:31.265717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-62944685-da75-4a82-8e71-a77d2dea2f5d tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments/0e0534b4-c319-4a22-aafa-4cb46a148bf5" status: 200 len: 194 microversion: 2.20 time: 0.045951 Aug 02 09:00:31.266278 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 283/567] 10.222.0.17 () {60 vars in 1454 bytes} [Tue Aug 2 09:00:31 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments/0e0534b4-c319-4a22-aafa-4cb46a148bf5 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:00:31.331360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f207c885-3e4d-4e66-88c8-b0a777f0a8e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:31.331841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f207c885-3e4d-4e66-88c8-b0a777f0a8e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:31.334648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=15 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:31.335306 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=24 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:31.341306 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f207c885-3e4d-4e66-88c8-b0a777f0a8e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:31.341761 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f207c885-3e4d-4e66-88c8-b0a777f0a8e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:31.342535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f207c885-3e4d-4e66-88c8-b0a777f0a8e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:31.342973 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f207c885-3e4d-4e66-88c8-b0a777f0a8e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:31.421935 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-f207c885-3e4d-4e66-88c8-b0a777f0a8e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lazy-loading 'services' on Instance uuid b1f9c72f-350b-428c-b020-d16159e0c991 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:00:31.491997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f207c885-3e4d-4e66-88c8-b0a777f0a8e4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments/0e0534b4-c319-4a22-aafa-4cb46a148bf5" status: 202 len: 0 microversion: 2.20 time: 0.165092 Aug 02 09:00:31.492899 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 285/568] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Aug 2 09:00:31 2022] DELETE /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments/0e0534b4-c319-4a22-aafa-4cb46a148bf5 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:00:31.502404 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9d8e600c-40bb-44d5-951a-b6a89b89e62c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:31.504573 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9d8e600c-40bb-44d5-951a-b6a89b89e62c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:31.510950 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9d8e600c-40bb-44d5-951a-b6a89b89e62c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:31.511422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9d8e600c-40bb-44d5-951a-b6a89b89e62c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:31.512302 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9d8e600c-40bb-44d5-951a-b6a89b89e62c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:31.512740 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9d8e600c-40bb-44d5-951a-b6a89b89e62c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:31.542864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9d8e600c-40bb-44d5-951a-b6a89b89e62c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045642 Aug 02 09:00:31.543720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 284/569] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 2 09:00:31 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:00:32.556105 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-521bb276-0833-451c-9700-180b61154e34 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:32.558545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-521bb276-0833-451c-9700-180b61154e34 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:32.566083 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-521bb276-0833-451c-9700-180b61154e34 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:32.566539 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-521bb276-0833-451c-9700-180b61154e34 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:32.567317 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-521bb276-0833-451c-9700-180b61154e34 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:32.567759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-521bb276-0833-451c-9700-180b61154e34 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:32.597349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-521bb276-0833-451c-9700-180b61154e34 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045496 Aug 02 09:00:32.597827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 286/570] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 2 09:00:32 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:00:33.610310 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-16302a05-c9f5-43c3-9c38-8591dca98738 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:33.612401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-16302a05-c9f5-43c3-9c38-8591dca98738 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:33.618970 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-16302a05-c9f5-43c3-9c38-8591dca98738 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:33.619417 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-16302a05-c9f5-43c3-9c38-8591dca98738 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:33.620216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-16302a05-c9f5-43c3-9c38-8591dca98738 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:33.620650 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-16302a05-c9f5-43c3-9c38-8591dca98738 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:33.650913 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-16302a05-c9f5-43c3-9c38-8591dca98738 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045080 Aug 02 09:00:33.651497 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 285/571] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 2 09:00:33 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:33.712662 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9647b8b6-cddc-48ce-b202-a129345c9031 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:33.713159 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9647b8b6-cddc-48ce-b202-a129345c9031 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:33.719784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9647b8b6-cddc-48ce-b202-a129345c9031 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:33.720284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9647b8b6-cddc-48ce-b202-a129345c9031 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:33.721060 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9647b8b6-cddc-48ce-b202-a129345c9031 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:33.722325 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9647b8b6-cddc-48ce-b202-a129345c9031 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:33.747388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9647b8b6-cddc-48ce-b202-a129345c9031 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Going to try to terminate instance {{(pid=117773) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:00:33.821617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9647b8b6-cddc-48ce-b202-a129345c9031 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 204 len: 0 microversion: 2.20 time: 0.112508 Aug 02 09:00:33.822193 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 287/572] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 2 09:00:33 2022] DELETE /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:00:33.831792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:33.832701 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:33.838645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:33.839094 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:33.839868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:33.840346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:33.969849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:33.977810 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:33.979330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:33.980515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6f4d049c-f71a-441e-8eb6-8ed5a5ae0063 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.153949 Aug 02 09:00:33.981069 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 286/573] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:33 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:00:35.005014 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:35.005741 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:35.012215 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:35.012666 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:35.013432 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:35.014585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:35.143966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:35.151976 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:35.153521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:35.154678 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b6a10b88-79db-4ff7-b8b0-f022ffbbc05c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.153974 Aug 02 09:00:35.155245 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 288/574] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:34 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:36.177803 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:36.178374 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:36.184987 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:36.185448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:36.186791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:36.187234 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:36.424225 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:36.432243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:36.433697 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:36.434856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-62ef395b-ca0e-47aa-8d7d-4e7b45b49adf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1724 microversion: 2.20 time: 0.261040 Aug 02 09:00:36.435658 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 287/575] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:36 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:37.350340 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-bd99a1e4-5824-4c9d-9d53-73c040bb46ef req-01569cfa-5ddc-46e9-9b47-87f57ee036c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f9c72f-350b-428c-b020-d16159e0c991", "name": "network-vif-deleted", "tag": "f3e02b9c-83d3-460c-8aac-b98eba055bb0"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:00:37.361343 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-bd99a1e4-5824-4c9d-9d53-73c040bb46ef req-01569cfa-5ddc-46e9-9b47-87f57ee036c4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:37.361762 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-bd99a1e4-5824-4c9d-9d53-73c040bb46ef req-01569cfa-5ddc-46e9-9b47-87f57ee036c4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:37.374058 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-bd99a1e4-5824-4c9d-9d53-73c040bb46ef req-01569cfa-5ddc-46e9-9b47-87f57ee036c4 service nova] Creating event network-vif-deleted:f3e02b9c-83d3-460c-8aac-b98eba055bb0 for instance b1f9c72f-350b-428c-b020-d16159e0c991 on hv-cinder-78729 Aug 02 09:00:37.379011 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-bd99a1e4-5824-4c9d-9d53-73c040bb46ef req-01569cfa-5ddc-46e9-9b47-87f57ee036c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032215 Aug 02 09:00:37.383531 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 289/576] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:00:37.459010 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:37.459621 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:37.470381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:37.470831 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:37.471631 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:37.472070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:37.553383 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:37.564831 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:37.566922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:37.568450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8fcdf33d-f36f-4128-a67f-6c3dbd242261 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 200 len: 1366 microversion: 2.20 time: 0.113670 Aug 02 09:00:37.586057 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 288/577] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:37 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:38.595026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:38.595827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:38.602290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:38.602901 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:38.603741 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:38.604275 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:38.619551 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] HTTP exception thrown: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Request method failure captured: Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 HTTP/1.1 Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYTjUbpm6WqGV57WtQmMCq7myk5Pd-YjkSM6X_-HfnY7HVNQ-HsTIED1GaQq8hajNi9675OI2PHojOXCBFKjRzMigFbX0VKIcobl99NYaIgb6zEK0MYXjCl4lVqGHTdgtVFn0q0-AkH6ENODPRtNtM-ARwoZC3SCz0G69lOyp7GTh8 Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:00:38.621274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1cb1f802c78a4317a0af32afb533eb8a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}] Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: e846d960fa87451db8ae291e22b3cb7b Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:00:38.622997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'b1f9c72f-350b-428c-b020-d16159e0c991'} Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:00:38.623923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:00:38.625284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:00:38.626469 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Returning 404 to user: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:00:38.626469 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a90298d6-99b6-409f-aee6-f975b8d691f7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 404 len: 111 microversion: 2.20 time: 0.033142 Aug 02 09:00:38.626469 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 290/578] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:38 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:00:38.633876 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-17e2db21-dd74-46cd-9161-f9982bd127a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '.version_select at 0x7f13fa987160>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:38.659162 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-17e2db21-dd74-46cd-9161-f9982bd127a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018435939" status: 204 len: 0 microversion: 2.20 time: 0.030787 Aug 02 09:00:38.659815 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 289/579] 10.222.0.17 () {60 vars in 1262 bytes} [Tue Aug 2 09:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018435939 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 09:00:39.398456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e63d9db1-3fb9-42fc-ad60-2052416f5a8f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'create', calling method: .version_select at 0x7f13fa97a430>, body: {"keypair": {"name": "tempest-keypair-860377018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiF6yp3zAY0Fo1XJ47O/KeuxWEwQrCIugT2AQnFbLwzLUnVfiaFx3Jk6RGUDb4Pgir7lnZot6t8pUFFpKsyuMZ/pKIFgiXuo6yo1DgpP2RonLRqAHemTy9OyeXmVQxWMA=="}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:00:39.421359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-e63d9db1-3fb9-42fc-ad60-2052416f5a8f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Getting quotas for project 1cb1f802c78a4317a0af32afb533eb8a. Resources: {'key_pairs'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:00:39.426880 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-e63d9db1-3fb9-42fc-ad60-2052416f5a8f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Getting quotas for user e846d960fa87451db8ae291e22b3cb7b and project 1cb1f802c78a4317a0af32afb533eb8a. Resources: {'key_pairs'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:00:39.453163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e63d9db1-3fb9-42fc-ad60-2052416f5a8f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.063451 Aug 02 09:00:39.453783 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 291/580] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Aug 2 09:00:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 02 09:00:40.654941 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-480349621", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e28baa36-2ada-4198-89c4-451b2f06a562"}], "security_groups": [{"name": "tempest-securitygroup--804446617"}], "key_name": "tempest-keypair-860377018", "user_data": "}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:00:40.763365 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] validate_networks() for [('e28baa36-2ada-4198-89c4-451b2f06a562', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:00:41.131461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:00:41.131885 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:00:41.132394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:00:41.132808 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:00:41.133222 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:00:41.142272 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:41.142721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:41.143534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:41.143977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:41.162292 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Getting quotas for project 1cb1f802c78a4317a0af32afb533eb8a. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:00:41.167025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Getting quotas for user e846d960fa87451db8ae291e22b3cb7b and project 1cb1f802c78a4317a0af32afb533eb8a. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:00:41.179074 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:00:41.181395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:00:41.227000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-052c63fb-0e0c-4799-bb3b-40b03943d21c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.577060 Aug 02 09:00:41.227973 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 290/581] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Aug 2 09:00:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 09:00:41.239306 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5e99092a-cc66-4e13-8240-915b2364ce27 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:41.239924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5e99092a-cc66-4e13-8240-915b2364ce27 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:41.296149 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5e99092a-cc66-4e13-8240-915b2364ce27 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:41.303311 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5e99092a-cc66-4e13-8240-915b2364ce27 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:41.304927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5e99092a-cc66-4e13-8240-915b2364ce27 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:41.306348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5e99092a-cc66-4e13-8240-915b2364ce27 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1280 microversion: 2.20 time: 0.070986 Aug 02 09:00:41.306896 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 292/582] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:41 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:42.328937 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:42.329882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:42.338274 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:42.338762 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:42.339571 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:42.340040 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:42.423947 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:42.432636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:42.434184 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:42.435333 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-75b4ec3f-b368-450d-a0f4-6bae161336de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1340 microversion: 2.20 time: 0.110377 Aug 02 09:00:42.436201 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 291/583] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:42 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1340 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:43.459999 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:43.460599 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:43.467632 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:43.468087 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:43.468917 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:43.469549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:43.603088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:43.611633 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:43.613175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:43.614331 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-2421bad2-d9e0-4115-9401-e239867f8cec tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.158622 Aug 02 09:00:43.614936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 293/584] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:43 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:43.859520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-b42366f5-ecc3-4092-853b-6684fafc7c35 req-9b8ef692-25ef-430e-b6a1-8a58374a61a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1276a55d-d8fd-439c-abd7-16eeb8c44304", "tag": "e7195430-61af-498a-b128-9ae974ec3d07"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:00:43.870775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b42366f5-ecc3-4092-853b-6684fafc7c35 req-9b8ef692-25ef-430e-b6a1-8a58374a61a7 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:43.871313 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b42366f5-ecc3-4092-853b-6684fafc7c35 req-9b8ef692-25ef-430e-b6a1-8a58374a61a7 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:43.884332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-b42366f5-ecc3-4092-853b-6684fafc7c35 req-9b8ef692-25ef-430e-b6a1-8a58374a61a7 service nova] Creating event network-changed:e7195430-61af-498a-b128-9ae974ec3d07 for instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 on hv-cinder-78729 Aug 02 09:00:43.889178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-b42366f5-ecc3-4092-853b-6684fafc7c35 req-9b8ef692-25ef-430e-b6a1-8a58374a61a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033991 Aug 02 09:00:43.889782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 292/585] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:00:44.637839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:44.638446 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:44.645591 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:44.646032 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:44.646781 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:44.647216 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:44.772805 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:44.780665 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:44.782176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:44.783264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1c72a737-5837-4e17-9d85-8c64315b58aa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.149328 Aug 02 09:00:44.783810 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 294/586] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:44 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:45.806779 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:45.807518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:45.813990 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:45.814438 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:45.815213 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:45.815654 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:45.946770 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:45.955154 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:45.956723 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:45.958087 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fb74f13a-e723-4006-9a9f-2d81711a7d17 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.156144 Aug 02 09:00:45.958647 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 293/587] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:45 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:46.981063 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:46.981670 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:46.988844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:46.989292 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:46.990058 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:46.990491 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:47.117445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:47.125317 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:47.126814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:47.127902 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f7ede263-14a4-470a-abcf-a5b7da3c7013 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.150814 Aug 02 09:00:47.128481 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 295/588] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:46 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:48.150458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:48.151160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:48.157877 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:48.158332 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:48.159109 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:48.159550 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:48.293125 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:48.301497 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:48.302999 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:48.304092 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-450f0d93-5796-46ad-8ab7-0e60b952e7b4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.157609 Aug 02 09:00:48.304674 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 294/589] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:48 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:49.327023 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:49.327743 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:49.334458 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:49.335025 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:49.335648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:49.336215 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:49.467526 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:49.475910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:49.477457 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:49.478550 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5e619346-437c-4bda-bd9a-e7fa90ecc89e tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.155445 Aug 02 09:00:49.479105 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 296/590] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:49 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:50.238466 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-6fda8633-5618-4c5d-a4da-c77882eb21d7 req-d2b30e12-fbc9-48c2-be78-1f973f347250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1276a55d-d8fd-439c-abd7-16eeb8c44304", "name": "network-vif-plugged", "status": "completed", "tag": "e7195430-61af-498a-b128-9ae974ec3d07"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:00:50.248787 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6fda8633-5618-4c5d-a4da-c77882eb21d7 req-d2b30e12-fbc9-48c2-be78-1f973f347250 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:50.249230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6fda8633-5618-4c5d-a4da-c77882eb21d7 req-d2b30e12-fbc9-48c2-be78-1f973f347250 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:50.260585 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-6fda8633-5618-4c5d-a4da-c77882eb21d7 req-d2b30e12-fbc9-48c2-be78-1f973f347250 service nova] Creating event network-vif-plugged:e7195430-61af-498a-b128-9ae974ec3d07 for instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 on hv-cinder-78729 Aug 02 09:00:50.265854 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-6fda8633-5618-4c5d-a4da-c77882eb21d7 req-d2b30e12-fbc9-48c2-be78-1f973f347250 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030486 Aug 02 09:00:50.266436 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 295/591] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:00:50.502373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:50.502988 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:50.510069 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:50.510568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:50.511663 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:50.512229 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:50.639957 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:50.647811 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:50.649456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:50.650540 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f75fe89f-d22a-447c-95b3-35df8cc4ca5b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.152838 Aug 02 09:00:50.651110 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 297/592] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:50 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:51.670885 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:51.671660 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=6 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:51.676893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:51.677593 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:51.684747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:51.685202 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:51.685966 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:51.686407 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:51.829739 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:51.837888 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:51.839387 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:51.840505 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ec5f5175-b07e-49d1-ae0d-9b59e4d98436 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.170602 Aug 02 09:00:51.841064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 296/593] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:51 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:52.864375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:52.864990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:52.866950 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=6 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:52.873475 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:52.873927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:52.874693 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:52.875129 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:53.006984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:53.015544 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:53.018420 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:53.018420 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-2214a262-67f0-4f4f-ad5e-f895ca620580 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1405 microversion: 2.20 time: 0.158377 Aug 02 09:00:53.019047 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 298/594] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:52 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:53.067688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fc33f957-1890-4834-be08-47bfbfaf4d73 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:53.068219 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fc33f957-1890-4834-be08-47bfbfaf4d73 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:53.074620 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fc33f957-1890-4834-be08-47bfbfaf4d73 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:53.075064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fc33f957-1890-4834-be08-47bfbfaf4d73 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:53.075826 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fc33f957-1890-4834-be08-47bfbfaf4d73 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:53.076298 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fc33f957-1890-4834-be08-47bfbfaf4d73 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:53.158429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-fc33f957-1890-4834-be08-47bfbfaf4d73 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lazy-loading 'services' on Instance uuid f003d009-ff7f-402b-8909-26d0e4ed705a {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:00:53.233139 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fc33f957-1890-4834-be08-47bfbfaf4d73 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments/68d49724-3a61-477d-8bd5-accea83b65e0" status: 202 len: 0 microversion: 2.1 time: 0.169257 Aug 02 09:00:53.233720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 297/595] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 09:00:53 2022] DELETE /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments/68d49724-3a61-477d-8bd5-accea83b65e0 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:00:53.242273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-261598f4-0b14-4ae8-b88c-cdf91ebbcbc6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:53.244675 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-261598f4-0b14-4ae8-b88c-cdf91ebbcbc6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:53.250664 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-261598f4-0b14-4ae8-b88c-cdf91ebbcbc6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:53.251327 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-261598f4-0b14-4ae8-b88c-cdf91ebbcbc6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:53.252094 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-261598f4-0b14-4ae8-b88c-cdf91ebbcbc6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:53.252601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-261598f4-0b14-4ae8-b88c-cdf91ebbcbc6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:53.283443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-261598f4-0b14-4ae8-b88c-cdf91ebbcbc6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Aug 02 09:00:53.283996 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 299/596] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:00:53 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:00:54.042053 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:54.042753 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:54.049129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:54.049586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:54.050361 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:54.050804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:54.185104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:54.201044 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:54.202761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:54.204465 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a1510a7f-08a0-42fd-b025-5418e09fa96f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1597 microversion: 2.20 time: 0.166310 Aug 02 09:00:54.205026 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 298/597] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:00:54 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:54.227465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6a77d971-2f11-4a4a-bcd1-584ff8a8ec39 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:54.227965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6a77d971-2f11-4a4a-bcd1-584ff8a8ec39 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:54.234687 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6a77d971-2f11-4a4a-bcd1-584ff8a8ec39 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:54.235134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6a77d971-2f11-4a4a-bcd1-584ff8a8ec39 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:54.235890 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6a77d971-2f11-4a4a-bcd1-584ff8a8ec39 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:54.236354 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6a77d971-2f11-4a4a-bcd1-584ff8a8ec39 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:54.296012 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-cdfc61b9-c98a-4769-9aa7-c0505f2a0fec tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:54.298310 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-cdfc61b9-c98a-4769-9aa7-c0505f2a0fec tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:54.304250 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cdfc61b9-c98a-4769-9aa7-c0505f2a0fec tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:54.304691 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cdfc61b9-c98a-4769-9aa7-c0505f2a0fec tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:54.305450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cdfc61b9-c98a-4769-9aa7-c0505f2a0fec tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:54.305881 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cdfc61b9-c98a-4769-9aa7-c0505f2a0fec tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:54.312138 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6a77d971-2f11-4a4a-bcd1-584ff8a8ec39 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088675 Aug 02 09:00:54.312737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 300/598] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Aug 2 09:00:54 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:00:54.336095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-cdfc61b9-c98a-4769-9aa7-c0505f2a0fec tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Aug 02 09:00:54.336688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 299/599] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:00:54 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:00:55.348802 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d81c56d4-4fde-4ba6-b73b-d7940334ba5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:55.350938 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d81c56d4-4fde-4ba6-b73b-d7940334ba5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:55.357192 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d81c56d4-4fde-4ba6-b73b-d7940334ba5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:55.357648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d81c56d4-4fde-4ba6-b73b-d7940334ba5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:55.358433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d81c56d4-4fde-4ba6-b73b-d7940334ba5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:55.358872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d81c56d4-4fde-4ba6-b73b-d7940334ba5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:55.387920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d81c56d4-4fde-4ba6-b73b-d7940334ba5a tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044105 Aug 02 09:00:55.388508 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 301/600] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:00:55 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:00:55.465093 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1be5d06d-264c-4075-88b5-58104533a579 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:55.465667 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1be5d06d-264c-4075-88b5-58104533a579 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:55.473129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1be5d06d-264c-4075-88b5-58104533a579 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:55.473462 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1be5d06d-264c-4075-88b5-58104533a579 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:55.474079 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1be5d06d-264c-4075-88b5-58104533a579 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:55.474714 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1be5d06d-264c-4075-88b5-58104533a579 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:55.500382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1be5d06d-264c-4075-88b5-58104533a579 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:00:55.518776 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-b2938ea9-16b3-49df-839f-e835e31db2df req-05881679-c440-47ed-adc5-56f42827bd11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1276a55d-d8fd-439c-abd7-16eeb8c44304", "tag": "e7195430-61af-498a-b128-9ae974ec3d07"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:00:55.528334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-b2938ea9-16b3-49df-839f-e835e31db2df req-05881679-c440-47ed-adc5-56f42827bd11 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:55.529297 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-b2938ea9-16b3-49df-839f-e835e31db2df req-05881679-c440-47ed-adc5-56f42827bd11 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:55.537135 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:55.541153 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-b2938ea9-16b3-49df-839f-e835e31db2df req-05881679-c440-47ed-adc5-56f42827bd11 service nova] Creating event network-changed:e7195430-61af-498a-b128-9ae974ec3d07 for instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 on hv-cinder-78729 Aug 02 09:00:55.546408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-b2938ea9-16b3-49df-839f-e835e31db2df req-05881679-c440-47ed-adc5-56f42827bd11 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031744 Aug 02 09:00:55.550088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 302/601] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:00:55.585762 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1be5d06d-264c-4075-88b5-58104533a579 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 204 len: 0 microversion: 2.1 time: 0.124394 Aug 02 09:00:55.586690 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 300/602] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:00:55 2022] DELETE /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:00:55.595674 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d1ef4c9d-9d63-4b4b-88a9-417545b1703d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:55.596554 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d1ef4c9d-9d63-4b4b-88a9-417545b1703d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:55.603196 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c9d-9d63-4b4b-88a9-417545b1703d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:55.604057 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c9d-9d63-4b4b-88a9-417545b1703d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:55.605513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c9d-9d63-4b4b-88a9-417545b1703d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:55.606638 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c9d-9d63-4b4b-88a9-417545b1703d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:55.625607 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:55.743639 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d1ef4c9d-9d63-4b4b-88a9-417545b1703d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:55.751229 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d1ef4c9d-9d63-4b4b-88a9-417545b1703d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1689 microversion: 2.1 time: 0.160337 Aug 02 09:00:55.752102 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 303/603] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:55 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:56.772857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-46b64ee3-c4f7-4ac9-9601-a4d13caa2da9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:56.773486 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-46b64ee3-c4f7-4ac9-9601-a4d13caa2da9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:56.780000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-46b64ee3-c4f7-4ac9-9601-a4d13caa2da9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:56.780484 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-46b64ee3-c4f7-4ac9-9601-a4d13caa2da9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:56.781254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-46b64ee3-c4f7-4ac9-9601-a4d13caa2da9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:56.781699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-46b64ee3-c4f7-4ac9-9601-a4d13caa2da9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:56.914972 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-46b64ee3-c4f7-4ac9-9601-a4d13caa2da9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:56.922368 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-46b64ee3-c4f7-4ac9-9601-a4d13caa2da9 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1689 microversion: 2.1 time: 0.153883 Aug 02 09:00:56.923864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 301/604] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:56 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:57.944742 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6b5740c9-dcdd-4bb0-8ba2-26168d952fe1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:57.945346 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6b5740c9-dcdd-4bb0-8ba2-26168d952fe1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:57.951880 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6b5740c9-dcdd-4bb0-8ba2-26168d952fe1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:57.952355 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6b5740c9-dcdd-4bb0-8ba2-26168d952fe1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:57.953109 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6b5740c9-dcdd-4bb0-8ba2-26168d952fe1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:57.953560 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6b5740c9-dcdd-4bb0-8ba2-26168d952fe1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:58.083195 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6b5740c9-dcdd-4bb0-8ba2-26168d952fe1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:58.090599 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6b5740c9-dcdd-4bb0-8ba2-26168d952fe1 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1689 microversion: 2.1 time: 0.149706 Aug 02 09:00:58.091155 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 304/605] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:57 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:00:59.111429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1b11478a-861b-4b0e-9aeb-5165983e14d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:59.112036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1b11478a-861b-4b0e-9aeb-5165983e14d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:00:59.118676 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1b11478a-861b-4b0e-9aeb-5165983e14d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:59.119122 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1b11478a-861b-4b0e-9aeb-5165983e14d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:59.119882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1b11478a-861b-4b0e-9aeb-5165983e14d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:59.120356 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1b11478a-861b-4b0e-9aeb-5165983e14d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:59.296690 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1b11478a-861b-4b0e-9aeb-5165983e14d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:00:59.304775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1b11478a-861b-4b0e-9aeb-5165983e14d6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1689 microversion: 2.1 time: 0.197180 Aug 02 09:00:59.305464 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 302/606] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:00:59 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:00.326798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-844c1b10-d114-44be-b320-51970a000800 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:00.327392 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-844c1b10-d114-44be-b320-51970a000800 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:00.335176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-844c1b10-d114-44be-b320-51970a000800 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:00.335641 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-844c1b10-d114-44be-b320-51970a000800 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:00.336543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-844c1b10-d114-44be-b320-51970a000800 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:00.336994 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-844c1b10-d114-44be-b320-51970a000800 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:00.472202 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-844c1b10-d114-44be-b320-51970a000800 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:00.479690 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-844c1b10-d114-44be-b320-51970a000800 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 200 len: 1689 microversion: 2.1 time: 0.156823 Aug 02 09:01:00.480322 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 305/607] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:00 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:00.793978 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-581dbfa1-69c7-43b3-bcf3-1e079c0d7bd1 req-55e6db83-a845-4952-88c6-78943655aac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f003d009-ff7f-402b-8909-26d0e4ed705a", "name": "network-vif-deleted", "tag": "5a62ab27-1e19-43ae-907f-3e801613a1ff"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:00.805038 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-581dbfa1-69c7-43b3-bcf3-1e079c0d7bd1 req-55e6db83-a845-4952-88c6-78943655aac3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:00.805481 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-581dbfa1-69c7-43b3-bcf3-1e079c0d7bd1 req-55e6db83-a845-4952-88c6-78943655aac3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:00.820297 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-581dbfa1-69c7-43b3-bcf3-1e079c0d7bd1 req-55e6db83-a845-4952-88c6-78943655aac3 service nova] Creating event network-vif-deleted:5a62ab27-1e19-43ae-907f-3e801613a1ff for instance f003d009-ff7f-402b-8909-26d0e4ed705a on hv-cinder-78729 Aug 02 09:01:00.825771 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-581dbfa1-69c7-43b3-bcf3-1e079c0d7bd1 req-55e6db83-a845-4952-88c6-78943655aac3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036840 Aug 02 09:01:00.827056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 303/608] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:01.501266 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:01.502065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: f003d009-ff7f-402b-8909-26d0e4ed705a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:01.504515 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:01.510616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:01.511071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:01.511886 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:01.512367 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:01.527782 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] HTTP exception thrown: Instance f003d009-ff7f-402b-8909-26d0e4ed705a could not be found. Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Request method failure captured: Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a HTTP/1.1 Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYZjNzYbJ5mBqiE2yw1T0csKVjkN2yeNeBhK5jIkJf5Xit2MLjbd0yqZmm99CJaCh5ZZdqFbBlu92hhdlw-EYz45f_0D2SOxrdE-bMHcZ779szT2Jp0xIviqccPasp-mq_6P3R4IDJb3Df1HoMqvay8wfKTym7FTWpIoNgdlwBZpl4 Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:01:01.529444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4c886ec53c84d5d9542ab7dbbdfcf8b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}] Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 7ed1be3a1ae249828caa8b88fd606557 Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance f003d009-ff7f-402b-8909-26d0e4ed705a could not be found. Aug 02 09:01:01.531099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'f003d009-ff7f-402b-8909-26d0e4ed705a'} Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f003d009-ff7f-402b-8909-26d0e4ed705a could not be found. Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:01:01.532620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f003d009-ff7f-402b-8909-26d0e4ed705a could not be found. Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f003d009-ff7f-402b-8909-26d0e4ed705a could not be found. Aug 02 09:01:01.534647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:01.536325 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Returning 404 to user: Instance f003d009-ff7f-402b-8909-26d0e4ed705a could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:01:01.536325 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1b28b2e5-3f0f-49aa-b556-af307cdf554d tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a" status: 404 len: 111 microversion: 2.1 time: 0.033543 Aug 02 09:01:01.536325 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 306/609] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:01 2022] GET /compute/v2.1/servers/f003d009-ff7f-402b-8909-26d0e4ed705a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:01:01.541386 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9d6c856a-4306-41f7-8f42-7316c9815c2e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '.version_select at 0x7f13fabef0d0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:01.548394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:01.564393 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9d6c856a-4306-41f7-8f42-7316c9815c2e tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627452945" status: 202 len: 0 microversion: 2.1 time: 0.027188 Aug 02 09:01:01.565222 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 304/610] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 2 09:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627452945 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:01:04.677563 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f18c9646-566a-4eca-83b9-010db98fcfab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:04.678053 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f18c9646-566a-4eca-83b9-010db98fcfab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:04.684688 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f18c9646-566a-4eca-83b9-010db98fcfab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:04.685130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f18c9646-566a-4eca-83b9-010db98fcfab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:04.685884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f18c9646-566a-4eca-83b9-010db98fcfab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:04.686343 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f18c9646-566a-4eca-83b9-010db98fcfab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:04.711839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f18c9646-566a-4eca-83b9-010db98fcfab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Going to try to terminate instance {{(pid=117773) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:01:04.785368 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f18c9646-566a-4eca-83b9-010db98fcfab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 204 len: 0 microversion: 2.1 time: 0.111313 Aug 02 09:01:04.785953 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 307/611] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:01:04 2022] DELETE /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:01:04.796016 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20a0edf3-7958-4378-a3c5-68e96a6578ab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:04.796806 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-20a0edf3-7958-4378-a3c5-68e96a6578ab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:04.805017 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20a0edf3-7958-4378-a3c5-68e96a6578ab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:04.805470 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20a0edf3-7958-4378-a3c5-68e96a6578ab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:04.806282 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20a0edf3-7958-4378-a3c5-68e96a6578ab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:04.807149 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20a0edf3-7958-4378-a3c5-68e96a6578ab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:04.935758 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-20a0edf3-7958-4378-a3c5-68e96a6578ab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:04.943256 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-20a0edf3-7958-4378-a3c5-68e96a6578ab tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1507 microversion: 2.1 time: 0.152956 Aug 02 09:01:04.943818 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 305/612] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:04 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:05.965474 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-429e94db-3e25-4968-a163-98a1055bc7c6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:05.966292 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-429e94db-3e25-4968-a163-98a1055bc7c6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:05.973168 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-429e94db-3e25-4968-a163-98a1055bc7c6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:05.973621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-429e94db-3e25-4968-a163-98a1055bc7c6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:05.974395 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-429e94db-3e25-4968-a163-98a1055bc7c6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:05.974846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-429e94db-3e25-4968-a163-98a1055bc7c6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:06.109642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-429e94db-3e25-4968-a163-98a1055bc7c6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:06.117708 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-429e94db-3e25-4968-a163-98a1055bc7c6 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 200 len: 1507 microversion: 2.1 time: 0.156461 Aug 02 09:01:06.118272 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 308/613] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:05 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:06.324190 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-885c3840-7c94-457a-81bb-d31e681e09a5 req-8a8b9f37-d26d-4f86-b4b0-d9fd4386a5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa787e93-b3ba-4022-83c9-b3bf91be48ea", "name": "network-vif-deleted", "tag": "53ef7d9d-8440-4f6f-8c2f-22ebcc0b6c0b"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:06.335075 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-885c3840-7c94-457a-81bb-d31e681e09a5 req-8a8b9f37-d26d-4f86-b4b0-d9fd4386a5bb service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:06.335527 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-885c3840-7c94-457a-81bb-d31e681e09a5 req-8a8b9f37-d26d-4f86-b4b0-d9fd4386a5bb service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:06.347150 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-885c3840-7c94-457a-81bb-d31e681e09a5 req-8a8b9f37-d26d-4f86-b4b0-d9fd4386a5bb service nova] Creating event network-vif-deleted:53ef7d9d-8440-4f6f-8c2f-22ebcc0b6c0b for instance aa787e93-b3ba-4022-83c9-b3bf91be48ea on hv-cinder-78729 Aug 02 09:01:06.352712 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-885c3840-7c94-457a-81bb-d31e681e09a5 req-8a8b9f37-d26d-4f86-b4b0-d9fd4386a5bb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Aug 02 09:01:06.353330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 306/614] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:07.138636 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:07.139236 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: aa787e93-b3ba-4022-83c9-b3bf91be48ea] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:07.146230 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.146681 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.147471 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.147918 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.160968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] HTTP exception thrown: Instance aa787e93-b3ba-4022-83c9-b3bf91be48ea could not be found. Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Request method failure captured: Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea HTTP/1.1 Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYZjNzYbJ5mBqiE2yw1T0csKVjkN2yeNeBhK5jIkJf5Xit2MLjbd0yqZmm99CJaCh5ZZdqFbBlu92hhdlw-EYz45f_0D2SOxrdE-bMHcZ779szT2Jp0xIviqccPasp-mq_6P3R4IDJb3Df1HoMqvay8wfKTym7FTWpIoNgdlwBZpl4 Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:01:07.162566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4c886ec53c84d5d9542ab7dbbdfcf8b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}] Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 7ed1be3a1ae249828caa8b88fd606557 Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance aa787e93-b3ba-4022-83c9-b3bf91be48ea could not be found. Aug 02 09:01:07.164033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'aa787e93-b3ba-4022-83c9-b3bf91be48ea'} Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa787e93-b3ba-4022-83c9-b3bf91be48ea could not be found. Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:01:07.164962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa787e93-b3ba-4022-83c9-b3bf91be48ea could not be found. Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa787e93-b3ba-4022-83c9-b3bf91be48ea could not be found. Aug 02 09:01:07.166389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.167661 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Returning 404 to user: Instance aa787e93-b3ba-4022-83c9-b3bf91be48ea could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:01:07.167661 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-04a0c808-a8f6-4cde-97f0-b3be1390271c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea" status: 404 len: 111 microversion: 2.1 time: 0.029365 Aug 02 09:01:07.167661 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 309/615] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:07 2022] GET /compute/v2.1/servers/aa787e93-b3ba-4022-83c9-b3bf91be48ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:01:07.172983 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c12e418f-8709-4dbb-ba46-b1ef9cfba21c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:07.173569 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c12e418f-8709-4dbb-ba46-b1ef9cfba21c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:07.179701 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c12e418f-8709-4dbb-ba46-b1ef9cfba21c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.180184 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c12e418f-8709-4dbb-ba46-b1ef9cfba21c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.180953 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c12e418f-8709-4dbb-ba46-b1ef9cfba21c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.181394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c12e418f-8709-4dbb-ba46-b1ef9cfba21c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.206519 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c12e418f-8709-4dbb-ba46-b1ef9cfba21c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:01:07.279630 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c12e418f-8709-4dbb-ba46-b1ef9cfba21c tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "DELETE /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 204 len: 0 microversion: 2.1 time: 0.110492 Aug 02 09:01:07.280351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 307/616] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:01:07 2022] DELETE /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:01:07.288942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3f5e5adc-41a0-4394-8d70-bcc3aa870536 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:07.289824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3f5e5adc-41a0-4394-8d70-bcc3aa870536 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:07.297245 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f5e5adc-41a0-4394-8d70-bcc3aa870536 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.297696 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f5e5adc-41a0-4394-8d70-bcc3aa870536 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.298469 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f5e5adc-41a0-4394-8d70-bcc3aa870536 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.298905 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f5e5adc-41a0-4394-8d70-bcc3aa870536 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.428496 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3f5e5adc-41a0-4394-8d70-bcc3aa870536 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:07.435976 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3f5e5adc-41a0-4394-8d70-bcc3aa870536 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.151364 Aug 02 09:01:07.436569 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 310/617] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:07 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:07.700549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8b682765-be0b-4f9d-97ab-84d938b82e1b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:07.701241 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8b682765-be0b-4f9d-97ab-84d938b82e1b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:07.707464 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8b682765-be0b-4f9d-97ab-84d938b82e1b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.707915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8b682765-be0b-4f9d-97ab-84d938b82e1b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.708706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8b682765-be0b-4f9d-97ab-84d938b82e1b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.709148 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8b682765-be0b-4f9d-97ab-84d938b82e1b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.732009 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8b682765-be0b-4f9d-97ab-84d938b82e1b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7/ips" status: 200 len: 149 microversion: 2.1 time: 0.085305 Aug 02 09:01:07.732586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 308/618] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 09:01:07 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7/ips => generated 149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:07.745368 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e49f212-657a-4f30-908a-f54bd4a1b030"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:07.748435 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:07.755221 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.755672 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.756481 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.756922 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.839920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Invalid volume: volume 9e49f212-657a-4f30-908a-f54bd4a1b030 is already attached to instances: 8f712963-5f32-4332-b6e9-30269a5dccd1 Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: POST /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7/os-volume_attachments HTTP/1.1 Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 74 Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:01:07.841598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {"volumeAttachment": {"volumeId": "9e49f212-657a-4f30-908a-f54bd4a1b030"}} Aug 02 09:01:07.842895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Invalid volume: volume 9e49f212-657a-4f30-908a-f54bd4a1b030 is already attached to instances: 8f712963-5f32-4332-b6e9-30269a5dccd1 Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'server_id': '88d22468-69c0-45b8-8ee0-0bc6247befa7', 'body': {'volumeAttachment': {'volumeId': '9e49f212-657a-4f30-908a-f54bd4a1b030'}}} Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e49f212-657a-4f30-908a-f54bd4a1b030 is already attached to instances: 8f712963-5f32-4332-b6e9-30269a5dccd1 Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.843695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e49f212-657a-4f30-908a-f54bd4a1b030 is already attached to instances: 8f712963-5f32-4332-b6e9-30269a5dccd1 Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:07.845414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:07.846602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:07.846602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:01:07.846602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:01:07.846602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e49f212-657a-4f30-908a-f54bd4a1b030 is already attached to instances: 8f712963-5f32-4332-b6e9-30269a5dccd1 Aug 02 09:01:07.846602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:07.846602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 400 to user: Invalid volume: volume 9e49f212-657a-4f30-908a-f54bd4a1b030 is already attached to instances: 8f712963-5f32-4332-b6e9-30269a5dccd1 {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:01:07.846602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1d2e210e-e28c-4792-84d1-cde63bb5ad90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101703 Aug 02 09:01:07.846602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 311/619] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 09:01:07 2022] POST /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:01:07.852526 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-44020e45-a33b-47d6-86b6-a5382c0f047a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:07.853023 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-44020e45-a33b-47d6-86b6-a5382c0f047a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:07.859021 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-44020e45-a33b-47d6-86b6-a5382c0f047a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.859468 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-44020e45-a33b-47d6-86b6-a5382c0f047a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.860903 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-44020e45-a33b-47d6-86b6-a5382c0f047a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.861341 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-44020e45-a33b-47d6-86b6-a5382c0f047a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.886122 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-44020e45-a33b-47d6-86b6-a5382c0f047a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:01:07.961985 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-44020e45-a33b-47d6-86b6-a5382c0f047a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 204 len: 0 microversion: 2.1 time: 0.112920 Aug 02 09:01:07.962500 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 309/620] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:01:07 2022] DELETE /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:01:07.971116 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f0ae8fa3-d20f-4085-b763-42f10c5e3a62 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:07.971729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f0ae8fa3-d20f-4085-b763-42f10c5e3a62 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:07.977737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0ae8fa3-d20f-4085-b763-42f10c5e3a62 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.978209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0ae8fa3-d20f-4085-b763-42f10c5e3a62 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:07.978977 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0ae8fa3-d20f-4085-b763-42f10c5e3a62 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:07.979413 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f0ae8fa3-d20f-4085-b763-42f10c5e3a62 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:08.112870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f0ae8fa3-d20f-4085-b763-42f10c5e3a62 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:08.120409 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f0ae8fa3-d20f-4085-b763-42f10c5e3a62 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1680 microversion: 2.1 time: 0.153599 Aug 02 09:01:08.120973 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 312/621] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:07 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:08.457607 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0bf4dab0-251c-459c-b1ed-ea73610994d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:08.458399 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0bf4dab0-251c-459c-b1ed-ea73610994d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:08.464406 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0bf4dab0-251c-459c-b1ed-ea73610994d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:08.464852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0bf4dab0-251c-459c-b1ed-ea73610994d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:08.465608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0bf4dab0-251c-459c-b1ed-ea73610994d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:08.466042 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0bf4dab0-251c-459c-b1ed-ea73610994d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:08.596103 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0bf4dab0-251c-459c-b1ed-ea73610994d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:08.603510 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0bf4dab0-251c-459c-b1ed-ea73610994d8 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.150335 Aug 02 09:01:08.604077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 310/622] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:08 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:09.142298 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-14c329fe-db6d-4097-b8ac-e0290d4bf199 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:09.142827 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-14c329fe-db6d-4097-b8ac-e0290d4bf199 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:09.149021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-14c329fe-db6d-4097-b8ac-e0290d4bf199 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:09.149473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-14c329fe-db6d-4097-b8ac-e0290d4bf199 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:09.150239 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-14c329fe-db6d-4097-b8ac-e0290d4bf199 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:09.150680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-14c329fe-db6d-4097-b8ac-e0290d4bf199 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:09.276067 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-14c329fe-db6d-4097-b8ac-e0290d4bf199 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:09.284145 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-14c329fe-db6d-4097-b8ac-e0290d4bf199 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1680 microversion: 2.1 time: 0.146364 Aug 02 09:01:09.284713 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 313/623] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:09 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:09.624533 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-eafc9afa-e95c-486c-8267-b583c6f34491 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:09.625124 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-eafc9afa-e95c-486c-8267-b583c6f34491 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:09.632360 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-eafc9afa-e95c-486c-8267-b583c6f34491 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:09.632794 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-eafc9afa-e95c-486c-8267-b583c6f34491 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:09.633593 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-eafc9afa-e95c-486c-8267-b583c6f34491 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:09.634022 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-eafc9afa-e95c-486c-8267-b583c6f34491 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:09.868418 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-eafc9afa-e95c-486c-8267-b583c6f34491 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:09.876754 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-eafc9afa-e95c-486c-8267-b583c6f34491 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1522 microversion: 2.1 time: 0.255378 Aug 02 09:01:09.877257 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 311/624] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:09 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:10.140929 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-445010e4-b8d9-4eb8-9edc-30f8f8610cae req-e6b78943-d261-4472-827b-228ce144475c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a7f63d-5a88-4149-ba8c-843268dae669", "name": "network-vif-deleted", "tag": "b4017272-12f4-4105-ad24-9c7d3c6b982e"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:10.155770 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-445010e4-b8d9-4eb8-9edc-30f8f8610cae req-e6b78943-d261-4472-827b-228ce144475c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:10.156378 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-445010e4-b8d9-4eb8-9edc-30f8f8610cae req-e6b78943-d261-4472-827b-228ce144475c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:10.169586 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-445010e4-b8d9-4eb8-9edc-30f8f8610cae req-e6b78943-d261-4472-827b-228ce144475c service nova] Creating event network-vif-deleted:b4017272-12f4-4105-ad24-9c7d3c6b982e for instance 64a7f63d-5a88-4149-ba8c-843268dae669 on hv-cinder-78729 Aug 02 09:01:10.175330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-445010e4-b8d9-4eb8-9edc-30f8f8610cae req-e6b78943-d261-4472-827b-228ce144475c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Aug 02 09:01:10.176337 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 314/625] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:10.306150 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-78b46ff3-9808-44d5-a4a9-ef34ec6830ef tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:10.306760 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-78b46ff3-9808-44d5-a4a9-ef34ec6830ef tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:10.314756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78b46ff3-9808-44d5-a4a9-ef34ec6830ef tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:10.315192 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78b46ff3-9808-44d5-a4a9-ef34ec6830ef tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:10.316130 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78b46ff3-9808-44d5-a4a9-ef34ec6830ef tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:10.316590 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78b46ff3-9808-44d5-a4a9-ef34ec6830ef tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:10.470389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-78b46ff3-9808-44d5-a4a9-ef34ec6830ef tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:10.478530 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-78b46ff3-9808-44d5-a4a9-ef34ec6830ef tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1680 microversion: 2.1 time: 0.176669 Aug 02 09:01:10.479104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 312/626] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:10 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:10.898246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:10.898952 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:10.905392 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:10.905855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:10.906615 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:10.907056 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:10.939284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:10.939831 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:10.940417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lazy-loading 'fault' on Instance uuid 64a7f63d-5a88-4149-ba8c-843268dae669 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:01:10.983104 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed1be3a1ae249828caa8b88fd606557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c886ec53c84d5d9542ab7dbbdfcf8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:10.990026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-59473024-98b6-419d-98a7-50c82ed523a0 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 200 len: 1312 microversion: 2.1 time: 0.095894 Aug 02 09:01:11.003221 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 315/627] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:10 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:11.499699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5f64de07-a3ee-4c1e-a6fe-31b814770bd0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:11.500357 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5f64de07-a3ee-4c1e-a6fe-31b814770bd0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:11.507482 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5f64de07-a3ee-4c1e-a6fe-31b814770bd0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:11.507926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5f64de07-a3ee-4c1e-a6fe-31b814770bd0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:11.508838 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5f64de07-a3ee-4c1e-a6fe-31b814770bd0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:11.509268 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5f64de07-a3ee-4c1e-a6fe-31b814770bd0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:11.603591 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-5f64de07-a3ee-4c1e-a6fe-31b814770bd0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:11.611816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5f64de07-a3ee-4c1e-a6fe-31b814770bd0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 200 len: 1613 microversion: 2.1 time: 0.115915 Aug 02 09:01:11.622224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 313/628] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:11 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:12.011028 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:12.011711 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] [instance: 64a7f63d-5a88-4149-ba8c-843268dae669] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:12.018766 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:12.019219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:12.019994 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:12.020474 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:12.034545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] HTTP exception thrown: Instance 64a7f63d-5a88-4149-ba8c-843268dae669 could not be found. Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Request method failure captured: Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 HTTP/1.1 Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYZjNzYbJ5mBqiE2yw1T0csKVjkN2yeNeBhK5jIkJf5Xit2MLjbd0yqZmm99CJaCh5ZZdqFbBlu92hhdlw-EYz45f_0D2SOxrdE-bMHcZ779szT2Jp0xIviqccPasp-mq_6P3R4IDJb3Df1HoMqvay8wfKTym7FTWpIoNgdlwBZpl4 Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:01:12.036235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a4c886ec53c84d5d9542ab7dbbdfcf8b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a4c886ec53c84d5d9542ab7dbbdfcf8b"}]}] Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: a4c886ec53c84d5d9542ab7dbbdfcf8b Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71327331 Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 7ed1be3a1ae249828caa8b88fd606557 Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71327331-project Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 64a7f63d-5a88-4149-ba8c-843268dae669 could not be found. Aug 02 09:01:12.037764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '64a7f63d-5a88-4149-ba8c-843268dae669'} Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a7f63d-5a88-4149-ba8c-843268dae669 could not be found. Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:01:12.038676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a7f63d-5a88-4149-ba8c-843268dae669 could not be found. Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a7f63d-5a88-4149-ba8c-843268dae669 could not be found. Aug 02 09:01:12.040219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.041630 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] Returning 404 to user: Instance 64a7f63d-5a88-4149-ba8c-843268dae669 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:01:12.041630 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-2626cec9-d9ef-4674-b021-e30398b0fc74 tempest-ServerRescueNegativeTestJSON-71327331 tempest-ServerRescueNegativeTestJSON-71327331-project] 10.222.0.17 "GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669" status: 404 len: 111 microversion: 2.1 time: 0.030577 Aug 02 09:01:12.047250 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 316/629] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:12 2022] GET /compute/v2.1/servers/64a7f63d-5a88-4149-ba8c-843268dae669 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:01:12.194707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-5c82e980-40c1-40ff-9215-f9309a0dc853 req-32a307e6-89d6-454b-ad16-116d1b25f078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d22468-69c0-45b8-8ee0-0bc6247befa7", "name": "network-vif-deleted", "tag": "37c8c717-c415-4033-831f-a3fe6f63a25e"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:12.214400 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-5c82e980-40c1-40ff-9215-f9309a0dc853 req-32a307e6-89d6-454b-ad16-116d1b25f078 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:12.215355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-5c82e980-40c1-40ff-9215-f9309a0dc853 req-32a307e6-89d6-454b-ad16-116d1b25f078 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:12.232592 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-5c82e980-40c1-40ff-9215-f9309a0dc853 req-32a307e6-89d6-454b-ad16-116d1b25f078 service nova] Creating event network-vif-deleted:37c8c717-c415-4033-831f-a3fe6f63a25e for instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 on hv-cinder-78729 Aug 02 09:01:12.240386 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-5c82e980-40c1-40ff-9215-f9309a0dc853 req-32a307e6-89d6-454b-ad16-116d1b25f078 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049428 Aug 02 09:01:12.241605 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 314/630] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:12.634668 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:12.635284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:12.642240 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:12.642734 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:12.643501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:12.643962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:12.657317 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 HTTP/1.1 Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:01:12.658870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:01:12.660503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '88d22468-69c0-45b8-8ee0-0bc6247befa7'} Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:01:12.661640 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:01:12.662824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:12.664501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:01:12.664501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6a08278b-689a-447a-8d80-9a6b79b61a1f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 404 len: 111 microversion: 2.1 time: 0.029559 Aug 02 09:01:12.664501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 317/631] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:12 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:01:12.669543 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a26f1196-d4b6-4084-9049-50fe0ecb7817 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '.version_select at 0x7f13faaa2940>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:12.689543 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a26f1196-d4b6-4084-9049-50fe0ecb7817 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-160019730" status: 202 len: 0 microversion: 2.1 time: 0.024055 Aug 02 09:01:12.690156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 315/632] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 2 09:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-160019730 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:01:13.379468 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-aa489746-e96b-47e7-95ad-647710f3f25f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:13.380232 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-aa489746-e96b-47e7-95ad-647710f3f25f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:13.386896 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa489746-e96b-47e7-95ad-647710f3f25f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:13.387474 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa489746-e96b-47e7-95ad-647710f3f25f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:13.388508 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa489746-e96b-47e7-95ad-647710f3f25f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:13.389057 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-aa489746-e96b-47e7-95ad-647710f3f25f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:13.476425 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-aa489746-e96b-47e7-95ad-647710f3f25f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lazy-loading 'services' on Instance uuid 8f712963-5f32-4332-b6e9-30269a5dccd1 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:01:13.547624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-aa489746-e96b-47e7-95ad-647710f3f25f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-volume_attachments/9e49f212-657a-4f30-908a-f54bd4a1b030" status: 202 len: 0 microversion: 2.1 time: 0.171957 Aug 02 09:01:13.551273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 318/633] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 09:01:13 2022] DELETE /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-volume_attachments/9e49f212-657a-4f30-908a-f54bd4a1b030 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:01:13.557120 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3320dae9-3b01-45a5-9f87-f8e724ef5665 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:13.560101 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3320dae9-3b01-45a5-9f87-f8e724ef5665 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:13.567471 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3320dae9-3b01-45a5-9f87-f8e724ef5665 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:13.568339 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3320dae9-3b01-45a5-9f87-f8e724ef5665 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:13.569707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3320dae9-3b01-45a5-9f87-f8e724ef5665 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:13.569707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3320dae9-3b01-45a5-9f87-f8e724ef5665 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:13.601453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3320dae9-3b01-45a5-9f87-f8e724ef5665 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048820 Aug 02 09:01:13.602036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 316/634] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:01:13 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:14.617209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c61e442e-6181-4809-85f4-1e1351f466c8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:14.622798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c61e442e-6181-4809-85f4-1e1351f466c8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:14.629623 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c61e442e-6181-4809-85f4-1e1351f466c8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:14.630080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c61e442e-6181-4809-85f4-1e1351f466c8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:14.630857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c61e442e-6181-4809-85f4-1e1351f466c8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:14.631296 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c61e442e-6181-4809-85f4-1e1351f466c8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:14.661855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c61e442e-6181-4809-85f4-1e1351f466c8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051437 Aug 02 09:01:14.662608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 319/635] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:01:14 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:01:14.728247 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3a74ff90-4b5a-49a9-a1f6-b72c23a5c8cf tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:14.728842 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3a74ff90-4b5a-49a9-a1f6-b72c23a5c8cf tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:14.735899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3a74ff90-4b5a-49a9-a1f6-b72c23a5c8cf tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:14.736372 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3a74ff90-4b5a-49a9-a1f6-b72c23a5c8cf tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:14.737231 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3a74ff90-4b5a-49a9-a1f6-b72c23a5c8cf tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:14.737761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3a74ff90-4b5a-49a9-a1f6-b72c23a5c8cf tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:14.762893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3a74ff90-4b5a-49a9-a1f6-b72c23a5c8cf tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:01:14.765684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:14.848871 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3a74ff90-4b5a-49a9-a1f6-b72c23a5c8cf tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 204 len: 0 microversion: 2.1 time: 0.124226 Aug 02 09:01:14.849486 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 317/636] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:01:14 2022] DELETE /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:01:14.858103 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f9cefa72-99a8-4691-af25-1e77d6dcd2d7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:14.858652 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f9cefa72-99a8-4691-af25-1e77d6dcd2d7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:14.865432 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f9cefa72-99a8-4691-af25-1e77d6dcd2d7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:14.866120 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f9cefa72-99a8-4691-af25-1e77d6dcd2d7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:14.866901 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f9cefa72-99a8-4691-af25-1e77d6dcd2d7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:14.867368 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f9cefa72-99a8-4691-af25-1e77d6dcd2d7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:15.033186 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f9cefa72-99a8-4691-af25-1e77d6dcd2d7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:15.038148 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:15.044305 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f9cefa72-99a8-4691-af25-1e77d6dcd2d7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1681 microversion: 2.1 time: 0.190072 Aug 02 09:01:15.045415 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 320/637] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:14 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:16.068730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6074128d-b064-4345-83ac-111defafb5fb tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:16.069465 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6074128d-b064-4345-83ac-111defafb5fb tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:16.076063 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6074128d-b064-4345-83ac-111defafb5fb tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:16.076582 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6074128d-b064-4345-83ac-111defafb5fb tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:16.077316 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6074128d-b064-4345-83ac-111defafb5fb tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:16.077750 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6074128d-b064-4345-83ac-111defafb5fb tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:16.293967 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6074128d-b064-4345-83ac-111defafb5fb tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:16.302873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6074128d-b064-4345-83ac-111defafb5fb tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1681 microversion: 2.1 time: 0.238342 Aug 02 09:01:16.303559 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 318/638] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:16 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:16.902261 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-b10839c0-f1d5-4de1-99ae-ac06163b99fb req-a9a4c68f-2301-47b2-84f5-a94a03dea2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f712963-5f32-4332-b6e9-30269a5dccd1", "name": "network-vif-deleted", "tag": "17befc5d-ad61-4c20-abc2-eb77700b5813"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:16.922140 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-b10839c0-f1d5-4de1-99ae-ac06163b99fb req-a9a4c68f-2301-47b2-84f5-a94a03dea2d5 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:16.923629 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-b10839c0-f1d5-4de1-99ae-ac06163b99fb req-a9a4c68f-2301-47b2-84f5-a94a03dea2d5 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:16.942715 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-b10839c0-f1d5-4de1-99ae-ac06163b99fb req-a9a4c68f-2301-47b2-84f5-a94a03dea2d5 service nova] Creating event network-vif-deleted:17befc5d-ad61-4c20-abc2-eb77700b5813 for instance 8f712963-5f32-4332-b6e9-30269a5dccd1 on hv-cinder-78729 Aug 02 09:01:16.949111 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-b10839c0-f1d5-4de1-99ae-ac06163b99fb req-a9a4c68f-2301-47b2-84f5-a94a03dea2d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059340 Aug 02 09:01:16.949701 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 321/639] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:17.325229 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:17.325842 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:17.333782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:17.334099 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:17.334912 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:17.335359 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:17.370492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:17.370947 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:17.371403 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lazy-loading 'fault' on Instance uuid 8f712963-5f32-4332-b6e9-30269a5dccd1 {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:01:17.421133 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:17.428998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fb89ac2a-3e93-4bc2-ad78-06de6f4537ca tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 200 len: 1332 microversion: 2.1 time: 0.107610 Aug 02 09:01:17.430063 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 319/640] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:17 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:18.008696 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-447b4e13-3dd9-4b03-acab-54db2439cf2b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:18.011760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-447b4e13-3dd9-4b03-acab-54db2439cf2b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:18.019779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-447b4e13-3dd9-4b03-acab-54db2439cf2b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:18.020602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-447b4e13-3dd9-4b03-acab-54db2439cf2b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:18.021467 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-447b4e13-3dd9-4b03-acab-54db2439cf2b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:18.022466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-447b4e13-3dd9-4b03-acab-54db2439cf2b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:18.053917 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-447b4e13-3dd9-4b03-acab-54db2439cf2b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049681 Aug 02 09:01:18.054792 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 322/641] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:01:18 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:01:18.148436 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6f868f47-5e60-45fa-a7b0-3a29823f97a3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:18.148956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6f868f47-5e60-45fa-a7b0-3a29823f97a3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:18.156435 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f868f47-5e60-45fa-a7b0-3a29823f97a3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:18.157462 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f868f47-5e60-45fa-a7b0-3a29823f97a3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:18.158459 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f868f47-5e60-45fa-a7b0-3a29823f97a3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:18.159114 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6f868f47-5e60-45fa-a7b0-3a29823f97a3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:18.187885 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6f868f47-5e60-45fa-a7b0-3a29823f97a3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:01:18.269011 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6f868f47-5e60-45fa-a7b0-3a29823f97a3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 204 len: 0 microversion: 2.1 time: 0.124582 Aug 02 09:01:18.270275 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 320/642] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:01:18 2022] DELETE /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:01:18.279177 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d3e74790-190d-40ec-8918-9f16911bd934 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:18.279900 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d3e74790-190d-40ec-8918-9f16911bd934 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:18.286929 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3e74790-190d-40ec-8918-9f16911bd934 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:18.287443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3e74790-190d-40ec-8918-9f16911bd934 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:18.288442 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3e74790-190d-40ec-8918-9f16911bd934 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:18.288885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3e74790-190d-40ec-8918-9f16911bd934 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:18.423585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3e74790-190d-40ec-8918-9f16911bd934 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:18.431332 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d3e74790-190d-40ec-8918-9f16911bd934 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1673 microversion: 2.1 time: 0.156299 Aug 02 09:01:18.432038 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 323/643] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:18 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:18.454524 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:18.455326 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:18.462530 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:18.463083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:18.463852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:18.464642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:18.478549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 HTTP/1.1 Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:01:18.480224 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:01:18.481706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '8f712963-5f32-4332-b6e9-30269a5dccd1'} Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:01:18.482443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:01:18.483628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:01:18.484820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:01:18.484820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-552d1992-7e84-406b-b7b1-3d9c723194d0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 404 len: 111 microversion: 2.1 time: 0.032565 Aug 02 09:01:18.484820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 321/644] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:18 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:01:18.490564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-03c21479-2a14-4326-aebc-2d8739640e5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '.version_select at 0x7f13faa238b0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:18.511396 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-03c21479-2a14-4326-aebc-2d8739640e5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678686346" status: 202 len: 0 microversion: 2.1 time: 0.024502 Aug 02 09:01:18.512076 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 324/645] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 2 09:01:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678686346 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:01:19.176877 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fad871e7-ddbf-415d-aec7-eef2271f2604 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: .version_select at 0x7f13faa5cb80>, body: {"keypair": {"name": "tempest-keypair-431726767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3vYFU4hD+deEPFzudRlAhqPedeAKR4Vk4xpGi8kG6NLAmlTOiu5jT3WCpWhX2fT668+uylO07WBl9fpQ/qH2dZkf/Vx8+JaxnHIdBLyClt/1qbGv1mf/l/vkB8BJtw2A=="}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:19.191860 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-fad871e7-ddbf-415d-aec7-eef2271f2604 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for project 3179955b76864553a96682674d01b781. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:01:19.195791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-fad871e7-ddbf-415d-aec7-eef2271f2604 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for user f01062e92f974dc890897d19359e7e63 and project 3179955b76864553a96682674d01b781. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:01:19.218584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fad871e7-ddbf-415d-aec7-eef2271f2604 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046556 Aug 02 09:01:19.219812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 322/646] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 09:01:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:19.457783 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e0f7da8a-7461-466b-975d-d9ba737d3712 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:19.459196 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e0f7da8a-7461-466b-975d-d9ba737d3712 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:19.467148 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e0f7da8a-7461-466b-975d-d9ba737d3712 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:19.468054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e0f7da8a-7461-466b-975d-d9ba737d3712 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:19.468923 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e0f7da8a-7461-466b-975d-d9ba737d3712 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:19.469916 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e0f7da8a-7461-466b-975d-d9ba737d3712 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:19.667472 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e0f7da8a-7461-466b-975d-d9ba737d3712 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:19.681947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e0f7da8a-7461-466b-975d-d9ba737d3712 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1673 microversion: 2.1 time: 0.230067 Aug 02 09:01:19.682964 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 325/647] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:19 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1673 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:20.702873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-403c764b-cbcc-4fc2-a197-eec6d11f24f9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:20.703795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-403c764b-cbcc-4fc2-a197-eec6d11f24f9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:20.711532 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-403c764b-cbcc-4fc2-a197-eec6d11f24f9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:20.711977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-403c764b-cbcc-4fc2-a197-eec6d11f24f9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:20.712783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-403c764b-cbcc-4fc2-a197-eec6d11f24f9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:20.713230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-403c764b-cbcc-4fc2-a197-eec6d11f24f9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:20.755237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-936181277", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99261d5d-9777-4359-9363-b7001791ac96"}], "security_groups": [{"name": "tempest-securitygroup--1024508662"}], "key_name": "tempest-keypair-431726767", "user_data": "}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:20.812416 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-403c764b-cbcc-4fc2-a197-eec6d11f24f9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:20.822808 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-403c764b-cbcc-4fc2-a197-eec6d11f24f9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 200 len: 1606 microversion: 2.1 time: 0.123650 Aug 02 09:01:20.823925 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 323/648] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:20 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 1606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:20.876037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] validate_networks() for [('99261d5d-9777-4359-9363-b7001791ac96', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:01:20.885114 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-6a927fa3-d598-435f-a12b-f87d5c616eb0 req-524ac69a-aca8-4c03-89ec-26bf489954f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92713a6-b49a-4dd4-b944-0d370dd4326d", "name": "network-vif-deleted", "tag": "095a6c69-d447-4b1f-90e1-70752ef97699"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:20.910689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6a927fa3-d598-435f-a12b-f87d5c616eb0 req-524ac69a-aca8-4c03-89ec-26bf489954f3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:20.911174 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6a927fa3-d598-435f-a12b-f87d5c616eb0 req-524ac69a-aca8-4c03-89ec-26bf489954f3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:20.930139 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-6a927fa3-d598-435f-a12b-f87d5c616eb0 req-524ac69a-aca8-4c03-89ec-26bf489954f3 service nova] Creating event network-vif-deleted:095a6c69-d447-4b1f-90e1-70752ef97699 for instance a92713a6-b49a-4dd4-b944-0d370dd4326d on hv-cinder-78729 Aug 02 09:01:20.936229 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-6a927fa3-d598-435f-a12b-f87d5c616eb0 req-524ac69a-aca8-4c03-89ec-26bf489954f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054316 Aug 02 09:01:20.937598 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 324/649] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:01:21.297468 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:01:21.297912 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:01:21.298393 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:01:21.298800 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:01:21.299210 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:01:21.308479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:21.308927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:21.309927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:21.310543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:21.327284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for project 3179955b76864553a96682674d01b781. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:01:21.331739 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for user f01062e92f974dc890897d19359e7e63 and project 3179955b76864553a96682674d01b781. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:01:21.345427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:01:21.347843 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:01:21.401709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-88443baa-4671-4921-9bbe-96ead8969404 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650605 Aug 02 09:01:21.402674 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 326/650] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:01:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:01:21.413798 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-983b92ef-1a01-41e4-b038-cd05e75fee3e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:21.414493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-983b92ef-1a01-41e4-b038-cd05e75fee3e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:21.475645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-983b92ef-1a01-41e4-b038-cd05e75fee3e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:21.485790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-983b92ef-1a01-41e4-b038-cd05e75fee3e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1240 microversion: 2.1 time: 0.076067 Aug 02 09:01:21.487014 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 325/651] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:21 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:21.844756 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:21.845368 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:21.854670 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:21.856017 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:21.856848 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:21.857290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:21.875047 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] HTTP exception thrown: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Request method failure captured: Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d HTTP/1.1 Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYcek9YCzLwsmB6KPO36rL13cyDyidbzXGve9Ps-f00TBANRX-Hi_-rFnluXS2qvLuovLnNvy__4y0dHqzSKAopMuU8bbf6eSToIKdABew7yNStouoFdNgslNZG0LgKI8HdUYQQqTWLNpQRZt0cPOtzj2ZhQsd6gg_FoYGvyZPDPa0 Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:01:21.878324 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f068d1fec9a4e55b60cd782cf4ecf89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}] Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 2b15c4ba64ca4097a4cdb653fdb94d78 Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:01:21.879754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'a92713a6-b49a-4dd4-b944-0d370dd4326d'} Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:01:21.880634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:01:21.881911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:01:21.885673 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Returning 404 to user: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:01:21.886673 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-08643c6c-3802-49ce-9096-269ab4869bb3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 404 len: 111 microversion: 2.1 time: 0.045875 Aug 02 09:01:21.887268 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 327/652] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:21 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:01:21.896658 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9071f5b6-d85b-465b-bf1b-09d2f87c1356 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '.version_select at 0x7f14009128b0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:21.926409 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9071f5b6-d85b-465b-bf1b-09d2f87c1356 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857626531" status: 202 len: 0 microversion: 2.1 time: 0.033988 Aug 02 09:01:21.927867 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 326/653] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 2 09:01:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857626531 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:01:22.507566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3f220e0b-c1b1-41ef-9b06-4de42353faf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:22.508183 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3f220e0b-c1b1-41ef-9b06-4de42353faf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:22.514977 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f220e0b-c1b1-41ef-9b06-4de42353faf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:22.515529 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f220e0b-c1b1-41ef-9b06-4de42353faf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:22.516974 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f220e0b-c1b1-41ef-9b06-4de42353faf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:22.517415 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f220e0b-c1b1-41ef-9b06-4de42353faf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:22.611266 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3f220e0b-c1b1-41ef-9b06-4de42353faf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:22.620064 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3f220e0b-c1b1-41ef-9b06-4de42353faf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1292 microversion: 2.1 time: 0.116534 Aug 02 09:01:22.620908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 328/654] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:22 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1292 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:22.646552 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1fa48668-0d7d-4e11-a7be-1364ecd1fe0b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'create', calling method: .version_select at 0x7f13fa94e430>, body: {"keypair": {"name": "tempest-keypair-212585880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9T7mgsHpD/9v5E3EyYEp2UPkDAkxGiH+DGvtw3oJB1u3HnxO9nqztFSNqKSxJ7hAgWXOQ/GP6xNBA5FD4bEUHDxOwBkIEWeyeMDtg82lkH85nOkpp6JaE8eAxDfViuFw=="}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:22.665854 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-1fa48668-0d7d-4e11-a7be-1364ecd1fe0b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Getting quotas for project 7f068d1fec9a4e55b60cd782cf4ecf89. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:01:22.671049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-1fa48668-0d7d-4e11-a7be-1364ecd1fe0b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Getting quotas for user 2b15c4ba64ca4097a4cdb653fdb94d78 and project 7f068d1fec9a4e55b60cd782cf4ecf89. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:01:22.686646 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:22.698731 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1fa48668-0d7d-4e11-a7be-1364ecd1fe0b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056275 Aug 02 09:01:22.699497 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 327/655] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 09:01:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:23.645009 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-868e255c-63a9-40be-8825-a195272f7132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:23.646395 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-868e255c-63a9-40be-8825-a195272f7132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:23.654928 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-868e255c-63a9-40be-8825-a195272f7132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:23.655554 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-868e255c-63a9-40be-8825-a195272f7132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:23.657004 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-868e255c-63a9-40be-8825-a195272f7132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:23.657991 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-868e255c-63a9-40be-8825-a195272f7132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:23.872103 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-868e255c-63a9-40be-8825-a195272f7132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:23.881011 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-868e255c-63a9-40be-8825-a195272f7132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.240022 Aug 02 09:01:23.891510 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 329/656] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:23 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:24.215324 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-2fd7cdfe-4224-402c-aa51-17fdd6f96471 req-7722ebeb-19e0-4a86-a9b2-f567d4a2efea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4168c7d4-9466-4939-8905-6e4eb6efa7c4", "tag": "8326a790-ccee-45b4-a712-473bad036556"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:24.230297 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-2fd7cdfe-4224-402c-aa51-17fdd6f96471 req-7722ebeb-19e0-4a86-a9b2-f567d4a2efea service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:24.230297 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-2fd7cdfe-4224-402c-aa51-17fdd6f96471 req-7722ebeb-19e0-4a86-a9b2-f567d4a2efea service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:24.235668 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-848995244", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f4da716-e6b0-4d5e-9aeb-55b720f45052"}], "security_groups": [{"name": "tempest-securitygroup--485791305"}], "key_name": "tempest-keypair-212585880", "user_data": "}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:24.240770 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-2fd7cdfe-4224-402c-aa51-17fdd6f96471 req-7722ebeb-19e0-4a86-a9b2-f567d4a2efea service nova] Creating event network-changed:8326a790-ccee-45b4-a712-473bad036556 for instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 on hv-cinder-78729 Aug 02 09:01:24.245771 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-2fd7cdfe-4224-402c-aa51-17fdd6f96471 req-7722ebeb-19e0-4a86-a9b2-f567d4a2efea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035736 Aug 02 09:01:24.246365 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 328/657] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:24.334965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] validate_networks() for [('6f4da716-e6b0-4d5e-9aeb-55b720f45052', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:01:24.693731 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:01:24.694312 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:01:24.694726 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:01:24.695130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:01:24.695536 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:01:24.704798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:24.705236 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:24.706025 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:24.706454 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:24.722926 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Getting quotas for project 7f068d1fec9a4e55b60cd782cf4ecf89. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:01:24.726655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Getting quotas for user 2b15c4ba64ca4097a4cdb653fdb94d78 and project 7f068d1fec9a4e55b60cd782cf4ecf89. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:01:24.737968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:01:24.740080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:01:24.784776 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-18e9a7e2-4544-4096-81de-edc7ed187cac tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.553391 Aug 02 09:01:24.785339 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 330/658] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:01:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:01:24.797562 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d236d721-6759-4d53-ac79-7e9e4d6dc609 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:24.798366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d236d721-6759-4d53-ac79-7e9e4d6dc609 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:24.855688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d236d721-6759-4d53-ac79-7e9e4d6dc609 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:24.864419 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d236d721-6759-4d53-ac79-7e9e4d6dc609 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1236 microversion: 2.1 time: 0.071565 Aug 02 09:01:24.865000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 329/659] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:24 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:24.903329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-62cd7935-babf-4beb-9b4b-dc727daaf507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:24.904431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-62cd7935-babf-4beb-9b4b-dc727daaf507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:24.911147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-62cd7935-babf-4beb-9b4b-dc727daaf507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:24.911604 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-62cd7935-babf-4beb-9b4b-dc727daaf507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:24.912417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-62cd7935-babf-4beb-9b4b-dc727daaf507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:24.912860 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-62cd7935-babf-4beb-9b4b-dc727daaf507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:25.048790 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-62cd7935-babf-4beb-9b4b-dc727daaf507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:25.056339 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-62cd7935-babf-4beb-9b4b-dc727daaf507 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.157560 Aug 02 09:01:25.056944 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 331/660] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:24 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:25.886490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1902cccb-ee58-423f-a7ea-9dcedecdfdde tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:25.887087 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1902cccb-ee58-423f-a7ea-9dcedecdfdde tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:25.898756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1902cccb-ee58-423f-a7ea-9dcedecdfdde tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:25.899343 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1902cccb-ee58-423f-a7ea-9dcedecdfdde tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:25.900187 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1902cccb-ee58-423f-a7ea-9dcedecdfdde tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:25.900649 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1902cccb-ee58-423f-a7ea-9dcedecdfdde tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:25.968341 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1902cccb-ee58-423f-a7ea-9dcedecdfdde tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:25.975848 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1902cccb-ee58-423f-a7ea-9dcedecdfdde tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1240 microversion: 2.1 time: 0.093320 Aug 02 09:01:25.976454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 330/661] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:25 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:26.077251 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7b5f36d5-826f-43eb-b065-75f379de8714 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:26.077795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7b5f36d5-826f-43eb-b065-75f379de8714 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:26.085191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7b5f36d5-826f-43eb-b065-75f379de8714 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:26.085636 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7b5f36d5-826f-43eb-b065-75f379de8714 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:26.086390 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7b5f36d5-826f-43eb-b065-75f379de8714 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:26.086825 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7b5f36d5-826f-43eb-b065-75f379de8714 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:26.220214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7b5f36d5-826f-43eb-b065-75f379de8714 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:26.228196 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7b5f36d5-826f-43eb-b065-75f379de8714 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.154785 Aug 02 09:01:26.228756 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 332/662] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:26 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:26.996629 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a7587979-eb83-4f80-b688-4b32ecbac34c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:26.997166 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a7587979-eb83-4f80-b688-4b32ecbac34c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:27.003750 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a7587979-eb83-4f80-b688-4b32ecbac34c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:27.004240 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a7587979-eb83-4f80-b688-4b32ecbac34c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:27.005003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a7587979-eb83-4f80-b688-4b32ecbac34c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:27.005441 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a7587979-eb83-4f80-b688-4b32ecbac34c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:27.065045 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a7587979-eb83-4f80-b688-4b32ecbac34c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:27.072230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a7587979-eb83-4f80-b688-4b32ecbac34c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1240 microversion: 2.1 time: 0.079566 Aug 02 09:01:27.072798 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 331/663] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:26 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:27.250187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d4363812-77af-418b-b993-c3a119086591 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:27.250705 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d4363812-77af-418b-b993-c3a119086591 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:27.257340 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d4363812-77af-418b-b993-c3a119086591 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:27.257821 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d4363812-77af-418b-b993-c3a119086591 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:27.258583 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d4363812-77af-418b-b993-c3a119086591 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:27.259013 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d4363812-77af-418b-b993-c3a119086591 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:27.400463 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d4363812-77af-418b-b993-c3a119086591 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:27.410101 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d4363812-77af-418b-b993-c3a119086591 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.163756 Aug 02 09:01:27.410911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 333/664] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:27 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:28.094759 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b763baaa-cdf8-4dc5-ba92-00a5718b9e08 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:28.095401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b763baaa-cdf8-4dc5-ba92-00a5718b9e08 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:28.103029 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b763baaa-cdf8-4dc5-ba92-00a5718b9e08 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:28.103620 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b763baaa-cdf8-4dc5-ba92-00a5718b9e08 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:28.104499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b763baaa-cdf8-4dc5-ba92-00a5718b9e08 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:28.105308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b763baaa-cdf8-4dc5-ba92-00a5718b9e08 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:28.219626 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b763baaa-cdf8-4dc5-ba92-00a5718b9e08 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:28.227628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b763baaa-cdf8-4dc5-ba92-00a5718b9e08 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1294 microversion: 2.1 time: 0.138060 Aug 02 09:01:28.228372 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 332/665] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:28 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:28.431449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3385c61b-1746-4641-81ef-271bf1d61f89 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:28.432214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3385c61b-1746-4641-81ef-271bf1d61f89 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:28.439012 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3385c61b-1746-4641-81ef-271bf1d61f89 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:28.439461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3385c61b-1746-4641-81ef-271bf1d61f89 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:28.440289 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3385c61b-1746-4641-81ef-271bf1d61f89 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:28.440754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3385c61b-1746-4641-81ef-271bf1d61f89 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:28.636933 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3385c61b-1746-4641-81ef-271bf1d61f89 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:28.650023 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3385c61b-1746-4641-81ef-271bf1d61f89 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.219159 Aug 02 09:01:28.651109 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 334/666] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:28 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:29.252461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-95e1012f-2f7d-4bd4-aa87-b77c783f747b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:29.253185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-95e1012f-2f7d-4bd4-aa87-b77c783f747b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:29.260139 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-95e1012f-2f7d-4bd4-aa87-b77c783f747b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:29.260755 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-95e1012f-2f7d-4bd4-aa87-b77c783f747b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:29.261631 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-95e1012f-2f7d-4bd4-aa87-b77c783f747b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:29.262171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-95e1012f-2f7d-4bd4-aa87-b77c783f747b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:29.407314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-95e1012f-2f7d-4bd4-aa87-b77c783f747b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:29.414997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-95e1012f-2f7d-4bd4-aa87-b77c783f747b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.169373 Aug 02 09:01:29.415624 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 333/667] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:29 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:29.681906 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b65fadde-686e-41b5-aefa-57545aaa252e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:29.682437 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b65fadde-686e-41b5-aefa-57545aaa252e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:29.684915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:29.690692 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b65fadde-686e-41b5-aefa-57545aaa252e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:29.691141 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b65fadde-686e-41b5-aefa-57545aaa252e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:29.691904 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b65fadde-686e-41b5-aefa-57545aaa252e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:29.692372 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b65fadde-686e-41b5-aefa-57545aaa252e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:29.826060 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b65fadde-686e-41b5-aefa-57545aaa252e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:29.833982 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b65fadde-686e-41b5-aefa-57545aaa252e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.156006 Aug 02 09:01:29.834585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 335/668] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:29 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:30.436152 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c92a41fc-97d9-49f4-9371-dc700d7bd4b9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:30.436849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c92a41fc-97d9-49f4-9371-dc700d7bd4b9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:30.444374 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c92a41fc-97d9-49f4-9371-dc700d7bd4b9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:30.444903 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c92a41fc-97d9-49f4-9371-dc700d7bd4b9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:30.445749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c92a41fc-97d9-49f4-9371-dc700d7bd4b9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:30.447842 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c92a41fc-97d9-49f4-9371-dc700d7bd4b9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:30.585462 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c92a41fc-97d9-49f4-9371-dc700d7bd4b9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:30.593625 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c92a41fc-97d9-49f4-9371-dc700d7bd4b9 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.161334 Aug 02 09:01:30.594377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 334/669] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:30 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:30.854942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b4176826-5a49-47a3-8cca-b7d558df837e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:30.855561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b4176826-5a49-47a3-8cca-b7d558df837e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:30.862276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b4176826-5a49-47a3-8cca-b7d558df837e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:30.862732 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b4176826-5a49-47a3-8cca-b7d558df837e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:30.863535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b4176826-5a49-47a3-8cca-b7d558df837e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:30.863976 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b4176826-5a49-47a3-8cca-b7d558df837e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:31.086435 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b4176826-5a49-47a3-8cca-b7d558df837e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:31.095046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b4176826-5a49-47a3-8cca-b7d558df837e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.243932 Aug 02 09:01:31.095912 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 336/670] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:30 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:31.237725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-66ea4e0f-821e-4b22-bd1c-f3477129dc8a req-c73797ed-dfe6-4e49-a1d5-18622be2a26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0294f72-846b-4b03-8c91-063f464f63ae", "tag": "750cd21e-fcf4-4d25-91ed-6d7d8912cfe5"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:31.249610 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-66ea4e0f-821e-4b22-bd1c-f3477129dc8a req-c73797ed-dfe6-4e49-a1d5-18622be2a26c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:31.250251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-66ea4e0f-821e-4b22-bd1c-f3477129dc8a req-c73797ed-dfe6-4e49-a1d5-18622be2a26c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:31.263643 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-66ea4e0f-821e-4b22-bd1c-f3477129dc8a req-c73797ed-dfe6-4e49-a1d5-18622be2a26c service nova] Creating event network-changed:750cd21e-fcf4-4d25-91ed-6d7d8912cfe5 for instance b0294f72-846b-4b03-8c91-063f464f63ae on hv-cinder-78729 Aug 02 09:01:31.269582 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-66ea4e0f-821e-4b22-bd1c-f3477129dc8a req-c73797ed-dfe6-4e49-a1d5-18622be2a26c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035622 Aug 02 09:01:31.270373 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 335/671] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:31.618784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-32ad81cb-5e81-4b10-b31c-0c38f36f94fa tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:31.619427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-32ad81cb-5e81-4b10-b31c-0c38f36f94fa tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:31.625485 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-32ad81cb-5e81-4b10-b31c-0c38f36f94fa tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:31.627234 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-32ad81cb-5e81-4b10-b31c-0c38f36f94fa tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:31.627876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-32ad81cb-5e81-4b10-b31c-0c38f36f94fa tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:31.628344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-32ad81cb-5e81-4b10-b31c-0c38f36f94fa tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:31.817496 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-32ad81cb-5e81-4b10-b31c-0c38f36f94fa tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:31.826026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-32ad81cb-5e81-4b10-b31c-0c38f36f94fa tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.210974 Aug 02 09:01:31.839546 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 337/672] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:31 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:32.117808 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-231f124f-b6d3-426a-881e-97142af4635d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:32.118513 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-231f124f-b6d3-426a-881e-97142af4635d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:32.124857 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-231f124f-b6d3-426a-881e-97142af4635d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:32.125308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-231f124f-b6d3-426a-881e-97142af4635d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:32.126075 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-231f124f-b6d3-426a-881e-97142af4635d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:32.126515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-231f124f-b6d3-426a-881e-97142af4635d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:32.265254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-231f124f-b6d3-426a-881e-97142af4635d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:32.273242 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-231f124f-b6d3-426a-881e-97142af4635d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.160104 Aug 02 09:01:32.273814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 336/673] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:32 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:01:32.846778 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-bd9c51c6-1718-485f-9355-9921586406cf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:32.847391 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-bd9c51c6-1718-485f-9355-9921586406cf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:32.854067 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bd9c51c6-1718-485f-9355-9921586406cf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:32.854511 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bd9c51c6-1718-485f-9355-9921586406cf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:32.855279 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bd9c51c6-1718-485f-9355-9921586406cf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:32.855716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-bd9c51c6-1718-485f-9355-9921586406cf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:32.986066 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-bd9c51c6-1718-485f-9355-9921586406cf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:32.993490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-bd9c51c6-1718-485f-9355-9921586406cf tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.150544 Aug 02 09:01:32.994052 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 338/674] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:32 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:33.294047 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8eeac9f7-5c49-4a09-b415-d4351be10399 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:33.294669 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8eeac9f7-5c49-4a09-b415-d4351be10399 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:33.302153 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eeac9f7-5c49-4a09-b415-d4351be10399 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:33.302599 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eeac9f7-5c49-4a09-b415-d4351be10399 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:33.303494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eeac9f7-5c49-4a09-b415-d4351be10399 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:33.303929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eeac9f7-5c49-4a09-b415-d4351be10399 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:33.435435 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8eeac9f7-5c49-4a09-b415-d4351be10399 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:33.443001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8eeac9f7-5c49-4a09-b415-d4351be10399 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.152887 Aug 02 09:01:33.443652 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 337/675] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:33 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:34.014147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d941b9d0-cf49-4072-ae91-c58ac4913b3b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:34.015683 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d941b9d0-cf49-4072-ae91-c58ac4913b3b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:34.023173 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d941b9d0-cf49-4072-ae91-c58ac4913b3b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:34.023634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d941b9d0-cf49-4072-ae91-c58ac4913b3b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:34.024447 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d941b9d0-cf49-4072-ae91-c58ac4913b3b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:34.024889 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d941b9d0-cf49-4072-ae91-c58ac4913b3b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:34.257463 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d941b9d0-cf49-4072-ae91-c58ac4913b3b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:34.265502 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d941b9d0-cf49-4072-ae91-c58ac4913b3b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.255187 Aug 02 09:01:34.266229 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 339/676] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:34 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:34.464937 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fffa4ea3-98c5-4147-90e1-a9126983bfd5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:34.465727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fffa4ea3-98c5-4147-90e1-a9126983bfd5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:34.473185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fffa4ea3-98c5-4147-90e1-a9126983bfd5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:34.473636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fffa4ea3-98c5-4147-90e1-a9126983bfd5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:34.474409 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fffa4ea3-98c5-4147-90e1-a9126983bfd5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:34.474855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fffa4ea3-98c5-4147-90e1-a9126983bfd5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:34.494178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:34.627717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fffa4ea3-98c5-4147-90e1-a9126983bfd5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:34.635191 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fffa4ea3-98c5-4147-90e1-a9126983bfd5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.174154 Aug 02 09:01:34.635764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 338/677] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:34 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:35.287437 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-69c15483-dec5-48a0-bc52-0d54b9a39c92 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:35.288046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-69c15483-dec5-48a0-bc52-0d54b9a39c92 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:35.289910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=4 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:35.290563 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=12 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:35.298071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-69c15483-dec5-48a0-bc52-0d54b9a39c92 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:35.298518 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-69c15483-dec5-48a0-bc52-0d54b9a39c92 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:35.299282 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-69c15483-dec5-48a0-bc52-0d54b9a39c92 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:35.299718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-69c15483-dec5-48a0-bc52-0d54b9a39c92 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:35.435376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-69c15483-dec5-48a0-bc52-0d54b9a39c92 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:35.443445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-69c15483-dec5-48a0-bc52-0d54b9a39c92 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.159781 Aug 02 09:01:35.444729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 340/678] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:35 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:35.655994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-19cd94ab-aea9-49e2-8018-75a5502f5a96 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:35.657147 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-19cd94ab-aea9-49e2-8018-75a5502f5a96 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:35.659071 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=12 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:35.665324 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-19cd94ab-aea9-49e2-8018-75a5502f5a96 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:35.665780 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-19cd94ab-aea9-49e2-8018-75a5502f5a96 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:35.666561 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-19cd94ab-aea9-49e2-8018-75a5502f5a96 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:35.667204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-19cd94ab-aea9-49e2-8018-75a5502f5a96 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:35.773786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-dfc2d8ba-53fd-496c-8510-b16f37e0ed27 req-be280572-2765-4b94-ac2a-8a2b7696f1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4168c7d4-9466-4939-8905-6e4eb6efa7c4", "name": "network-vif-plugged", "status": "completed", "tag": "8326a790-ccee-45b4-a712-473bad036556"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:35.789559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-dfc2d8ba-53fd-496c-8510-b16f37e0ed27 req-be280572-2765-4b94-ac2a-8a2b7696f1bd service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:35.790271 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-dfc2d8ba-53fd-496c-8510-b16f37e0ed27 req-be280572-2765-4b94-ac2a-8a2b7696f1bd service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:35.794924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=100 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:01:35.804705 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-dfc2d8ba-53fd-496c-8510-b16f37e0ed27 req-be280572-2765-4b94-ac2a-8a2b7696f1bd service nova] Creating event network-vif-plugged:8326a790-ccee-45b4-a712-473bad036556 for instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 on hv-cinder-78729 Aug 02 09:01:35.810820 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-dfc2d8ba-53fd-496c-8510-b16f37e0ed27 req-be280572-2765-4b94-ac2a-8a2b7696f1bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042999 Aug 02 09:01:35.811793 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 341/679] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:35.822802 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-19cd94ab-aea9-49e2-8018-75a5502f5a96 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:35.831314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-19cd94ab-aea9-49e2-8018-75a5502f5a96 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.179044 Aug 02 09:01:35.832512 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 339/680] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:35 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:36.467360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1d7c4e7d-850c-4acb-adba-3f455d41da4e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:36.468053 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1d7c4e7d-850c-4acb-adba-3f455d41da4e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:36.474932 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d7c4e7d-850c-4acb-adba-3f455d41da4e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:36.475403 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d7c4e7d-850c-4acb-adba-3f455d41da4e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:36.476283 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d7c4e7d-850c-4acb-adba-3f455d41da4e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:36.476718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d7c4e7d-850c-4acb-adba-3f455d41da4e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:36.606254 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1d7c4e7d-850c-4acb-adba-3f455d41da4e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:36.613635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1d7c4e7d-850c-4acb-adba-3f455d41da4e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.150484 Aug 02 09:01:36.614206 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 342/681] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:36 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:36.853228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-62b08901-263f-483b-b693-02f5124414c2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:36.853847 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-62b08901-263f-483b-b693-02f5124414c2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:36.860912 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62b08901-263f-483b-b693-02f5124414c2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:36.861406 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62b08901-263f-483b-b693-02f5124414c2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:36.862216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62b08901-263f-483b-b693-02f5124414c2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:36.862654 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-62b08901-263f-483b-b693-02f5124414c2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:36.989493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-62b08901-263f-483b-b693-02f5124414c2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:36.996860 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-62b08901-263f-483b-b693-02f5124414c2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.147538 Aug 02 09:01:36.997424 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 340/682] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:36 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:37.634908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7e403027-1cbe-4a0f-b5b6-56ab65a16b25 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:37.635513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7e403027-1cbe-4a0f-b5b6-56ab65a16b25 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:37.642451 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7e403027-1cbe-4a0f-b5b6-56ab65a16b25 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:37.642895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7e403027-1cbe-4a0f-b5b6-56ab65a16b25 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:37.643652 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7e403027-1cbe-4a0f-b5b6-56ab65a16b25 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:37.644084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7e403027-1cbe-4a0f-b5b6-56ab65a16b25 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:37.779780 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7e403027-1cbe-4a0f-b5b6-56ab65a16b25 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:37.787937 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7e403027-1cbe-4a0f-b5b6-56ab65a16b25 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.156862 Aug 02 09:01:37.788837 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 343/683] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:37 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:37.828720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-4275e0e0-8670-449d-9bd2-53e53bda6b00 req-c752d05e-b518-419d-9578-4a641debfc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0294f72-846b-4b03-8c91-063f464f63ae", "name": "network-vif-plugged", "status": "completed", "tag": "750cd21e-fcf4-4d25-91ed-6d7d8912cfe5"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:37.839051 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-4275e0e0-8670-449d-9bd2-53e53bda6b00 req-c752d05e-b518-419d-9578-4a641debfc21 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:37.839434 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-4275e0e0-8670-449d-9bd2-53e53bda6b00 req-c752d05e-b518-419d-9578-4a641debfc21 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:37.849881 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-4275e0e0-8670-449d-9bd2-53e53bda6b00 req-c752d05e-b518-419d-9578-4a641debfc21 service nova] Creating event network-vif-plugged:750cd21e-fcf4-4d25-91ed-6d7d8912cfe5 for instance b0294f72-846b-4b03-8c91-063f464f63ae on hv-cinder-78729 Aug 02 09:01:37.854776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-4275e0e0-8670-449d-9bd2-53e53bda6b00 req-c752d05e-b518-419d-9578-4a641debfc21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029746 Aug 02 09:01:37.855357 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 341/684] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:38.018541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e960a592-d6df-43e8-97b8-4fb9f87f06b7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:38.019150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e960a592-d6df-43e8-97b8-4fb9f87f06b7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:38.025294 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e960a592-d6df-43e8-97b8-4fb9f87f06b7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:38.025852 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e960a592-d6df-43e8-97b8-4fb9f87f06b7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:38.026618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e960a592-d6df-43e8-97b8-4fb9f87f06b7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:38.027054 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e960a592-d6df-43e8-97b8-4fb9f87f06b7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:38.176512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e960a592-d6df-43e8-97b8-4fb9f87f06b7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:38.184105 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e960a592-d6df-43e8-97b8-4fb9f87f06b7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1366 microversion: 2.1 time: 0.170097 Aug 02 09:01:38.184688 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 344/685] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:38 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:38.809915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1635ac23-0e3b-4015-931b-b9e516587b85 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:38.810625 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1635ac23-0e3b-4015-931b-b9e516587b85 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:38.817403 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1635ac23-0e3b-4015-931b-b9e516587b85 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:38.817860 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1635ac23-0e3b-4015-931b-b9e516587b85 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:38.818642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1635ac23-0e3b-4015-931b-b9e516587b85 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:38.819076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1635ac23-0e3b-4015-931b-b9e516587b85 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:38.949511 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1635ac23-0e3b-4015-931b-b9e516587b85 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:38.957815 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1635ac23-0e3b-4015-931b-b9e516587b85 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.152582 Aug 02 09:01:38.958376 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 342/686] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:38 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:39.205287 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1d0f71c6-5184-4caf-aff7-08a285efb6d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:39.205812 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1d0f71c6-5184-4caf-aff7-08a285efb6d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:39.212309 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d0f71c6-5184-4caf-aff7-08a285efb6d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:39.212758 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d0f71c6-5184-4caf-aff7-08a285efb6d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:39.213552 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d0f71c6-5184-4caf-aff7-08a285efb6d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:39.213980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d0f71c6-5184-4caf-aff7-08a285efb6d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:39.340421 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1d0f71c6-5184-4caf-aff7-08a285efb6d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:39.348309 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1d0f71c6-5184-4caf-aff7-08a285efb6d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1555 microversion: 2.1 time: 0.147142 Aug 02 09:01:39.348872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 345/687] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:39 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:39.369081 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0aa01d3c-612c-474c-bceb-1e179f26d7a1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:39.369605 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0aa01d3c-612c-474c-bceb-1e179f26d7a1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:39.375554 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0aa01d3c-612c-474c-bceb-1e179f26d7a1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:39.376004 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0aa01d3c-612c-474c-bceb-1e179f26d7a1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:39.376792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0aa01d3c-612c-474c-bceb-1e179f26d7a1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:39.377228 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0aa01d3c-612c-474c-bceb-1e179f26d7a1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:39.455816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0aa01d3c-612c-474c-bceb-1e179f26d7a1 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090508 Aug 02 09:01:39.456382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 343/688] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 2 09:01:39 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:39.977998 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8311bfbb-48b9-4a5e-834a-b7a7112e9e99 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:39.978858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8311bfbb-48b9-4a5e-834a-b7a7112e9e99 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:39.984884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8311bfbb-48b9-4a5e-834a-b7a7112e9e99 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:39.985948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8311bfbb-48b9-4a5e-834a-b7a7112e9e99 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:39.986715 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8311bfbb-48b9-4a5e-834a-b7a7112e9e99 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:39.987157 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8311bfbb-48b9-4a5e-834a-b7a7112e9e99 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:40.115102 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8311bfbb-48b9-4a5e-834a-b7a7112e9e99 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:40.122592 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8311bfbb-48b9-4a5e-834a-b7a7112e9e99 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1361 microversion: 2.1 time: 0.148441 Aug 02 09:01:40.123158 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 346/689] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:39 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:40.657046 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-5c146121-8cbe-4f02-84d3-a43f894f113c req-1382ac4e-740e-4fb7-9f32-ba5d0051c37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4168c7d4-9466-4939-8905-6e4eb6efa7c4", "tag": "8326a790-ccee-45b4-a712-473bad036556"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:40.667179 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-5c146121-8cbe-4f02-84d3-a43f894f113c req-1382ac4e-740e-4fb7-9f32-ba5d0051c37f service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:40.667622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-5c146121-8cbe-4f02-84d3-a43f894f113c req-1382ac4e-740e-4fb7-9f32-ba5d0051c37f service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:40.679177 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-5c146121-8cbe-4f02-84d3-a43f894f113c req-1382ac4e-740e-4fb7-9f32-ba5d0051c37f service nova] Creating event network-changed:8326a790-ccee-45b4-a712-473bad036556 for instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 on hv-cinder-78729 Aug 02 09:01:40.685721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-5c146121-8cbe-4f02-84d3-a43f894f113c req-1382ac4e-740e-4fb7-9f32-ba5d0051c37f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033221 Aug 02 09:01:40.686315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 344/690] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:41.143615 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fa4426c8-80bd-4283-be2a-44acb7dbd843 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:41.144174 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fa4426c8-80bd-4283-be2a-44acb7dbd843 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:41.150833 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fa4426c8-80bd-4283-be2a-44acb7dbd843 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:41.151277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fa4426c8-80bd-4283-be2a-44acb7dbd843 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:41.152289 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fa4426c8-80bd-4283-be2a-44acb7dbd843 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:41.152719 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fa4426c8-80bd-4283-be2a-44acb7dbd843 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:41.370804 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fa4426c8-80bd-4283-be2a-44acb7dbd843 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:01:41.378475 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fa4426c8-80bd-4283-be2a-44acb7dbd843 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1547 microversion: 2.1 time: 0.238966 Aug 02 09:01:41.379048 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 347/691] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:01:41 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:01:41.400699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-da79a54b-0190-4a9d-b0cc-b77bc37f0190 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:01:41.401532 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-da79a54b-0190-4a9d-b0cc-b77bc37f0190 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:01:41.408428 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da79a54b-0190-4a9d-b0cc-b77bc37f0190 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:41.408866 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da79a54b-0190-4a9d-b0cc-b77bc37f0190 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:41.409632 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da79a54b-0190-4a9d-b0cc-b77bc37f0190 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:41.410064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da79a54b-0190-4a9d-b0cc-b77bc37f0190 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:41.490966 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-da79a54b-0190-4a9d-b0cc-b77bc37f0190 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094810 Aug 02 09:01:41.491588 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 345/692] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 2 09:01:41 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:01:42.702986 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-a21e08c0-cd2c-445d-ad89-d8ce16583f80 req-82fb6321-a95f-41bb-b36a-319c44b00405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0294f72-846b-4b03-8c91-063f464f63ae", "tag": "750cd21e-fcf4-4d25-91ed-6d7d8912cfe5"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:01:42.714091 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-a21e08c0-cd2c-445d-ad89-d8ce16583f80 req-82fb6321-a95f-41bb-b36a-319c44b00405 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:01:42.714538 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-a21e08c0-cd2c-445d-ad89-d8ce16583f80 req-82fb6321-a95f-41bb-b36a-319c44b00405 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:01:42.725936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-a21e08c0-cd2c-445d-ad89-d8ce16583f80 req-82fb6321-a95f-41bb-b36a-319c44b00405 service nova] Creating event network-changed:750cd21e-fcf4-4d25-91ed-6d7d8912cfe5 for instance b0294f72-846b-4b03-8c91-063f464f63ae on hv-cinder-78729 Aug 02 09:01:42.730958 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-a21e08c0-cd2c-445d-ad89-d8ce16583f80 req-82fb6321-a95f-41bb-b36a-319c44b00405 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031620 Aug 02 09:01:42.731541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 348/693] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:14.441013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=38 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:14.442088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=32 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:14.447339 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-94261bbe-a908-4b28-8f73-e30e93c59b3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:14.448176 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-94261bbe-a908-4b28-8f73-e30e93c59b3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:14.457359 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-94261bbe-a908-4b28-8f73-e30e93c59b3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:14.457671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-94261bbe-a908-4b28-8f73-e30e93c59b3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:14.458450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-94261bbe-a908-4b28-8f73-e30e93c59b3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:14.458890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-94261bbe-a908-4b28-8f73-e30e93c59b3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:14.483512 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-94261bbe-a908-4b28-8f73-e30e93c59b3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lazy-loading 'flavor' on Instance uuid 3981c8ca-8909-4516-8813-e3a3cd71960b {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:02:14.558346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-94261bbe-a908-4b28-8f73-e30e93c59b3a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "POST /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b/action" status: 202 len: 0 microversion: 2.1 time: 0.118941 Aug 02 09:02:14.558996 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 346/694] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 09:02:14 2022] POST /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:02:14.566168 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=27 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:14.567070 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=38 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:14.571535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-72da38f3-b31a-4a61-b9d4-2fc11980acba tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:14.572288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-72da38f3-b31a-4a61-b9d4-2fc11980acba tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:14.579606 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-72da38f3-b31a-4a61-b9d4-2fc11980acba tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:14.580057 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-72da38f3-b31a-4a61-b9d4-2fc11980acba tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:14.581553 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-72da38f3-b31a-4a61-b9d4-2fc11980acba tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:14.582263 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-72da38f3-b31a-4a61-b9d4-2fc11980acba tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:14.722726 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-72da38f3-b31a-4a61-b9d4-2fc11980acba tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:14.730590 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-72da38f3-b31a-4a61-b9d4-2fc11980acba tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.166680 Aug 02 09:02:14.731139 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 349/695] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:14 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:15.754506 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4ce9fc49-e624-4b14-8ed7-015cbb0e0886 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:15.755429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4ce9fc49-e624-4b14-8ed7-015cbb0e0886 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:15.761888 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4ce9fc49-e624-4b14-8ed7-015cbb0e0886 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:15.762340 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4ce9fc49-e624-4b14-8ed7-015cbb0e0886 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:15.763122 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4ce9fc49-e624-4b14-8ed7-015cbb0e0886 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:15.763565 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4ce9fc49-e624-4b14-8ed7-015cbb0e0886 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:15.945868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4ce9fc49-e624-4b14-8ed7-015cbb0e0886 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:15.963180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4ce9fc49-e624-4b14-8ed7-015cbb0e0886 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.213463 Aug 02 09:02:15.963775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 347/696] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:15 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:16.984904 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1460e077-ce04-4b3d-b558-076f6d5026c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:16.985546 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1460e077-ce04-4b3d-b558-076f6d5026c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:16.992636 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1460e077-ce04-4b3d-b558-076f6d5026c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:16.993084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1460e077-ce04-4b3d-b558-076f6d5026c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:16.993850 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1460e077-ce04-4b3d-b558-076f6d5026c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:16.994286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1460e077-ce04-4b3d-b558-076f6d5026c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:17.135872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1460e077-ce04-4b3d-b558-076f6d5026c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:17.143360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1460e077-ce04-4b3d-b558-076f6d5026c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.162507 Aug 02 09:02:17.144444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 350/697] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:16 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:18.165089 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0e9ed245-8e59-4ac3-8480-49ed441110c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:18.166246 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0e9ed245-8e59-4ac3-8480-49ed441110c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:18.172785 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e9ed245-8e59-4ac3-8480-49ed441110c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:18.173243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e9ed245-8e59-4ac3-8480-49ed441110c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:18.174095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e9ed245-8e59-4ac3-8480-49ed441110c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:18.174448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e9ed245-8e59-4ac3-8480-49ed441110c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:18.317094 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0e9ed245-8e59-4ac3-8480-49ed441110c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:18.324518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0e9ed245-8e59-4ac3-8480-49ed441110c0 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.163318 Aug 02 09:02:18.325078 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 348/698] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:18 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:19.345528 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-77ea0360-e1d5-47ce-bd61-3f605883a757 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:19.346142 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-77ea0360-e1d5-47ce-bd61-3f605883a757 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:19.353058 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-77ea0360-e1d5-47ce-bd61-3f605883a757 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:19.353508 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-77ea0360-e1d5-47ce-bd61-3f605883a757 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:19.354461 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-77ea0360-e1d5-47ce-bd61-3f605883a757 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:19.354904 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-77ea0360-e1d5-47ce-bd61-3f605883a757 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:19.500440 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-77ea0360-e1d5-47ce-bd61-3f605883a757 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:19.508832 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-77ea0360-e1d5-47ce-bd61-3f605883a757 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.166830 Aug 02 09:02:19.509410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 351/699] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:19 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:20.530118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0d409c4d-f0f4-4a99-b854-b2950b1ac3f3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:20.530690 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0d409c4d-f0f4-4a99-b854-b2950b1ac3f3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:20.537774 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d409c4d-f0f4-4a99-b854-b2950b1ac3f3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:20.538214 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d409c4d-f0f4-4a99-b854-b2950b1ac3f3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:20.538970 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d409c4d-f0f4-4a99-b854-b2950b1ac3f3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:20.539406 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d409c4d-f0f4-4a99-b854-b2950b1ac3f3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:20.683491 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0d409c4d-f0f4-4a99-b854-b2950b1ac3f3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:20.691951 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0d409c4d-f0f4-4a99-b854-b2950b1ac3f3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.165783 Aug 02 09:02:20.692727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 349/700] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:20 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:21.713903 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8b494053-bd9f-43f8-aaa7-01aecac46970 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:21.714542 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8b494053-bd9f-43f8-aaa7-01aecac46970 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:21.720980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8b494053-bd9f-43f8-aaa7-01aecac46970 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:21.721430 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8b494053-bd9f-43f8-aaa7-01aecac46970 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:21.722840 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8b494053-bd9f-43f8-aaa7-01aecac46970 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:21.723273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8b494053-bd9f-43f8-aaa7-01aecac46970 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:21.855524 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8b494053-bd9f-43f8-aaa7-01aecac46970 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:21.863225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8b494053-bd9f-43f8-aaa7-01aecac46970 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.153379 Aug 02 09:02:21.863787 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 352/701] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:21 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:22.884234 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2244fc45-547a-472f-82e9-ebf50594ddf8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:22.884985 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2244fc45-547a-472f-82e9-ebf50594ddf8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:22.891662 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2244fc45-547a-472f-82e9-ebf50594ddf8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:22.892104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2244fc45-547a-472f-82e9-ebf50594ddf8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:22.892898 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2244fc45-547a-472f-82e9-ebf50594ddf8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:22.893327 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2244fc45-547a-472f-82e9-ebf50594ddf8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:23.031061 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2244fc45-547a-472f-82e9-ebf50594ddf8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:23.039190 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2244fc45-547a-472f-82e9-ebf50594ddf8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.158669 Aug 02 09:02:23.039718 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 350/702] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:22 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:24.060749 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-506e8030-a760-4464-8e71-fe1ab5993026 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:24.061355 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-506e8030-a760-4464-8e71-fe1ab5993026 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:24.069515 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-506e8030-a760-4464-8e71-fe1ab5993026 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:24.069958 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-506e8030-a760-4464-8e71-fe1ab5993026 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:24.070723 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-506e8030-a760-4464-8e71-fe1ab5993026 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:24.071154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-506e8030-a760-4464-8e71-fe1ab5993026 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:24.205545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-506e8030-a760-4464-8e71-fe1ab5993026 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:24.213584 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-506e8030-a760-4464-8e71-fe1ab5993026 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.156563 Aug 02 09:02:24.214152 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 353/703] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:24 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:25.235006 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-371e0ed6-a13d-4025-aaa8-5a90caffcb4f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:25.235674 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-371e0ed6-a13d-4025-aaa8-5a90caffcb4f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:25.242820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-371e0ed6-a13d-4025-aaa8-5a90caffcb4f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:25.243279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-371e0ed6-a13d-4025-aaa8-5a90caffcb4f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:25.244059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-371e0ed6-a13d-4025-aaa8-5a90caffcb4f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:25.244548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-371e0ed6-a13d-4025-aaa8-5a90caffcb4f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:25.383531 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-371e0ed6-a13d-4025-aaa8-5a90caffcb4f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:25.391979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-371e0ed6-a13d-4025-aaa8-5a90caffcb4f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.160953 Aug 02 09:02:25.392577 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 351/704] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:25 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:26.412959 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5e4dfdaf-d8ee-4e84-ae91-0274d7c8a362 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:26.413575 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5e4dfdaf-d8ee-4e84-ae91-0274d7c8a362 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:26.420818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e4dfdaf-d8ee-4e84-ae91-0274d7c8a362 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:26.421306 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e4dfdaf-d8ee-4e84-ae91-0274d7c8a362 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:26.422213 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e4dfdaf-d8ee-4e84-ae91-0274d7c8a362 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:26.422765 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5e4dfdaf-d8ee-4e84-ae91-0274d7c8a362 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:26.621778 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5e4dfdaf-d8ee-4e84-ae91-0274d7c8a362 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:26.630936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5e4dfdaf-d8ee-4e84-ae91-0274d7c8a362 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.222505 Aug 02 09:02:26.632603 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 354/705] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:26 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:27.653616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-263f7740-33e8-4776-9fa9-1627a8d6e18d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:27.654139 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-263f7740-33e8-4776-9fa9-1627a8d6e18d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:27.661317 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-263f7740-33e8-4776-9fa9-1627a8d6e18d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:27.661770 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-263f7740-33e8-4776-9fa9-1627a8d6e18d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:27.662539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-263f7740-33e8-4776-9fa9-1627a8d6e18d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:27.662989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-263f7740-33e8-4776-9fa9-1627a8d6e18d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:27.798146 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-263f7740-33e8-4776-9fa9-1627a8d6e18d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:27.805778 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-263f7740-33e8-4776-9fa9-1627a8d6e18d tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.156121 Aug 02 09:02:27.806337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 352/706] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:27 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:28.825846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3eb5c4a0-c087-4da4-8b77-861d8f770bd3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:28.826638 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3eb5c4a0-c087-4da4-8b77-861d8f770bd3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:28.833408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3eb5c4a0-c087-4da4-8b77-861d8f770bd3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:28.833894 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3eb5c4a0-c087-4da4-8b77-861d8f770bd3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:28.834670 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3eb5c4a0-c087-4da4-8b77-861d8f770bd3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:28.835111 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3eb5c4a0-c087-4da4-8b77-861d8f770bd3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:28.990372 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3eb5c4a0-c087-4da4-8b77-861d8f770bd3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:28.999474 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3eb5c4a0-c087-4da4-8b77-861d8f770bd3 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1568 microversion: 2.1 time: 0.177442 Aug 02 09:02:29.000040 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 355/707] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:28 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:29.021469 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b2f7a857-ae54-4b9c-956c-a310ea8b3565 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:29.022063 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b2f7a857-ae54-4b9c-956c-a310ea8b3565 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:29.029038 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b2f7a857-ae54-4b9c-956c-a310ea8b3565 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:29.029544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b2f7a857-ae54-4b9c-956c-a310ea8b3565 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:29.030443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b2f7a857-ae54-4b9c-956c-a310ea8b3565 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:29.030893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b2f7a857-ae54-4b9c-956c-a310ea8b3565 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:29.059821 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b2f7a857-ae54-4b9c-956c-a310ea8b3565 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117772) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:02:29.127500 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b2f7a857-ae54-4b9c-956c-a310ea8b3565 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "POST /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b/action" status: 202 len: 0 microversion: 2.1 time: 0.110560 Aug 02 09:02:29.128702 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 353/708] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 09:02:29 2022] POST /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:02:29.136738 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c37297fc-05b6-449d-9cb0-a8c86ab94b9f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:29.137428 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c37297fc-05b6-449d-9cb0-a8c86ab94b9f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:29.143521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c37297fc-05b6-449d-9cb0-a8c86ab94b9f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:29.144159 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c37297fc-05b6-449d-9cb0-a8c86ab94b9f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:29.145547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c37297fc-05b6-449d-9cb0-a8c86ab94b9f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:29.145997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c37297fc-05b6-449d-9cb0-a8c86ab94b9f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:29.290437 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c37297fc-05b6-449d-9cb0-a8c86ab94b9f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:29.298662 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c37297fc-05b6-449d-9cb0-a8c86ab94b9f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1576 microversion: 2.1 time: 0.165621 Aug 02 09:02:29.299369 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 356/709] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:29 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:30.321502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c128b488-d2e8-43f0-b6f6-ffc644fc829b tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:30.322216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c128b488-d2e8-43f0-b6f6-ffc644fc829b tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:30.328778 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c128b488-d2e8-43f0-b6f6-ffc644fc829b tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:30.329227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c128b488-d2e8-43f0-b6f6-ffc644fc829b tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:30.330004 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c128b488-d2e8-43f0-b6f6-ffc644fc829b tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:30.330442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c128b488-d2e8-43f0-b6f6-ffc644fc829b tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:30.472752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c128b488-d2e8-43f0-b6f6-ffc644fc829b tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:30.481470 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c128b488-d2e8-43f0-b6f6-ffc644fc829b tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1518 microversion: 2.1 time: 0.164378 Aug 02 09:02:30.482054 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 354/710] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:30 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:31.505208 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fa067553-d367-458a-9287-ae350d7cea64 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:31.505847 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fa067553-d367-458a-9287-ae350d7cea64 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:31.512624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fa067553-d367-458a-9287-ae350d7cea64 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:31.513072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fa067553-d367-458a-9287-ae350d7cea64 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:31.513846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fa067553-d367-458a-9287-ae350d7cea64 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:31.514278 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fa067553-d367-458a-9287-ae350d7cea64 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:31.710737 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-25fd39ae-07ad-4ca8-b5b7-592e16f68af6 req-c8e3c897-af61-4ff2-b110-752868d9c433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3981c8ca-8909-4516-8813-e3a3cd71960b", "name": "network-vif-unplugged", "status": "completed", "tag": "4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:31.724433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-25fd39ae-07ad-4ca8-b5b7-592e16f68af6 req-c8e3c897-af61-4ff2-b110-752868d9c433 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:31.724884 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-25fd39ae-07ad-4ca8-b5b7-592e16f68af6 req-c8e3c897-af61-4ff2-b110-752868d9c433 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:31.728928 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fa067553-d367-458a-9287-ae350d7cea64 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:31.740929 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fa067553-d367-458a-9287-ae350d7cea64 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.240158 Aug 02 09:02:31.741741 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 357/711] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:31 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:31.754944 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-25fd39ae-07ad-4ca8-b5b7-592e16f68af6 req-c8e3c897-af61-4ff2-b110-752868d9c433 service nova] Creating event network-vif-unplugged:4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55 for instance 3981c8ca-8909-4516-8813-e3a3cd71960b on hv-cinder-78729 Aug 02 09:02:31.760345 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-25fd39ae-07ad-4ca8-b5b7-592e16f68af6 req-c8e3c897-af61-4ff2-b110-752868d9c433 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054369 Aug 02 09:02:31.761191 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 355/712] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:02:32.763631 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-eb68c22e-1d78-49be-ad4f-d69296a41c81 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:32.764275 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-eb68c22e-1d78-49be-ad4f-d69296a41c81 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:32.771362 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb68c22e-1d78-49be-ad4f-d69296a41c81 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:32.771812 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb68c22e-1d78-49be-ad4f-d69296a41c81 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:32.772696 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb68c22e-1d78-49be-ad4f-d69296a41c81 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:32.773134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb68c22e-1d78-49be-ad4f-d69296a41c81 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:32.910669 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-eb68c22e-1d78-49be-ad4f-d69296a41c81 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:32.918524 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-eb68c22e-1d78-49be-ad4f-d69296a41c81 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.159470 Aug 02 09:02:32.919093 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 358/713] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:32 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:02:33.945981 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-afcc36f8-c44c-4393-834a-7753f93d85b2 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:33.946987 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-afcc36f8-c44c-4393-834a-7753f93d85b2 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:33.958562 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-afcc36f8-c44c-4393-834a-7753f93d85b2 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:33.959302 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-afcc36f8-c44c-4393-834a-7753f93d85b2 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:33.960637 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-afcc36f8-c44c-4393-834a-7753f93d85b2 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:33.961492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-afcc36f8-c44c-4393-834a-7753f93d85b2 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:34.111005 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-afcc36f8-c44c-4393-834a-7753f93d85b2 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:34.119657 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-afcc36f8-c44c-4393-834a-7753f93d85b2 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.183346 Aug 02 09:02:34.120276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 356/714] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:33 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:02:35.140479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0b8a0f81-f67a-492c-b94f-074b073bd3f8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:35.141262 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0b8a0f81-f67a-492c-b94f-074b073bd3f8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:35.148882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0b8a0f81-f67a-492c-b94f-074b073bd3f8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:35.149329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0b8a0f81-f67a-492c-b94f-074b073bd3f8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:35.150101 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0b8a0f81-f67a-492c-b94f-074b073bd3f8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:35.150596 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0b8a0f81-f67a-492c-b94f-074b073bd3f8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:35.300796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0b8a0f81-f67a-492c-b94f-074b073bd3f8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:35.309000 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0b8a0f81-f67a-492c-b94f-074b073bd3f8 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.172310 Aug 02 09:02:35.309577 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 359/715] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:35 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:36.330219 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0805f9b8-1439-467a-a5b0-891afae7a77f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:36.330833 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0805f9b8-1439-467a-a5b0-891afae7a77f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:36.338337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0805f9b8-1439-467a-a5b0-891afae7a77f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:36.338788 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0805f9b8-1439-467a-a5b0-891afae7a77f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:36.339564 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0805f9b8-1439-467a-a5b0-891afae7a77f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:36.340000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0805f9b8-1439-467a-a5b0-891afae7a77f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:36.480988 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0805f9b8-1439-467a-a5b0-891afae7a77f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:36.489278 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0805f9b8-1439-467a-a5b0-891afae7a77f tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.162951 Aug 02 09:02:36.489964 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 357/716] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:36 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:37.511267 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f9dc43a3-d41d-462a-bd4c-5e90d8161c06 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:37.511876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f9dc43a3-d41d-462a-bd4c-5e90d8161c06 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:37.519084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f9dc43a3-d41d-462a-bd4c-5e90d8161c06 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:37.519541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f9dc43a3-d41d-462a-bd4c-5e90d8161c06 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:37.520348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f9dc43a3-d41d-462a-bd4c-5e90d8161c06 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:37.520784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f9dc43a3-d41d-462a-bd4c-5e90d8161c06 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:37.648494 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9c6f9a64-06d8-4860-9d4d-53966553a04f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:37.649280 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9c6f9a64-06d8-4860-9d4d-53966553a04f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:37.656660 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9c6f9a64-06d8-4860-9d4d-53966553a04f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:37.656996 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9c6f9a64-06d8-4860-9d4d-53966553a04f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:37.657773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9c6f9a64-06d8-4860-9d4d-53966553a04f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:37.658418 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9c6f9a64-06d8-4860-9d4d-53966553a04f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:37.660643 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f9dc43a3-d41d-462a-bd4c-5e90d8161c06 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:37.669099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f9dc43a3-d41d-462a-bd4c-5e90d8161c06 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.161664 Aug 02 09:02:37.669999 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 360/717] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:37 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:37.683357 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9c6f9a64-06d8-4860-9d4d-53966553a04f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/ips" status: 200 len: 152 microversion: 2.20 time: 0.039598 Aug 02 09:02:37.684168 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 358/718] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Aug 2 09:02:37 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:02:38.690042 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-69cb7d0b-5725-4bf4-9687-6d2f071aac16 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:38.691166 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-69cb7d0b-5725-4bf4-9687-6d2f071aac16 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:38.697823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-69cb7d0b-5725-4bf4-9687-6d2f071aac16 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:38.698574 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-69cb7d0b-5725-4bf4-9687-6d2f071aac16 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:38.699434 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-69cb7d0b-5725-4bf4-9687-6d2f071aac16 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:38.699858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-69cb7d0b-5725-4bf4-9687-6d2f071aac16 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:38.835510 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-69cb7d0b-5725-4bf4-9687-6d2f071aac16 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:38.843333 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-69cb7d0b-5725-4bf4-9687-6d2f071aac16 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.157116 Aug 02 09:02:38.843957 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 361/719] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:38 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:39.864718 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7cfd7382-abc8-40f7-9a8f-848c29992141 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:39.865326 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7cfd7382-abc8-40f7-9a8f-848c29992141 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:39.871865 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7cfd7382-abc8-40f7-9a8f-848c29992141 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:39.872350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7cfd7382-abc8-40f7-9a8f-848c29992141 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:39.873118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7cfd7382-abc8-40f7-9a8f-848c29992141 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:39.873565 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7cfd7382-abc8-40f7-9a8f-848c29992141 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:40.005795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7cfd7382-abc8-40f7-9a8f-848c29992141 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:40.013211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7cfd7382-abc8-40f7-9a8f-848c29992141 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.152386 Aug 02 09:02:40.013776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 359/720] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:39 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:40.597726 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8f71ea5d-a684-4af4-9a39-78874aa0cbdc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:40.598253 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8f71ea5d-a684-4af4-9a39-78874aa0cbdc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:40.604779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8f71ea5d-a684-4af4-9a39-78874aa0cbdc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:40.605225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8f71ea5d-a684-4af4-9a39-78874aa0cbdc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:40.605986 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8f71ea5d-a684-4af4-9a39-78874aa0cbdc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:40.606417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8f71ea5d-a684-4af4-9a39-78874aa0cbdc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:40.630625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-8f71ea5d-a684-4af4-9a39-78874aa0cbdc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lazy-loading 'flavor' on Instance uuid 1276a55d-d8fd-439c-abd7-16eeb8c44304 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:02:40.819864 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8f71ea5d-a684-4af4-9a39-78874aa0cbdc tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/action" status: 202 len: 0 microversion: 2.20 time: 0.226010 Aug 02 09:02:40.820509 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 362/721] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 2 09:02:40 2022] POST /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:40.828795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:40.829837 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:40.837493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:40.838170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:40.839443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:40.840259 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:40.860950 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:40.999573 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:41.008395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:41.009997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:41.011222 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fb3567c3-194c-40fc-bd1e-9b9aa3945fc5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.186300 Aug 02 09:02:41.011888 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 360/722] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:40 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:41.037074 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-54170983-1b6a-4941-9825-f9daceae19ea tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:41.037800 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-54170983-1b6a-4941-9825-f9daceae19ea tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:41.046264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54170983-1b6a-4941-9825-f9daceae19ea tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:41.046634 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54170983-1b6a-4941-9825-f9daceae19ea tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:41.047418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54170983-1b6a-4941-9825-f9daceae19ea tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:41.047858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54170983-1b6a-4941-9825-f9daceae19ea tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:41.067367 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:41.298716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-54170983-1b6a-4941-9825-f9daceae19ea tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:41.307768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-54170983-1b6a-4941-9825-f9daceae19ea tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1574 microversion: 2.1 time: 0.276591 Aug 02 09:02:41.321372 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 363/723] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:41 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1574 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:42.039171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:42.039774 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:42.046525 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:42.046966 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:42.047896 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:42.048359 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:42.248996 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:42.257461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:42.259065 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:42.260260 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-35dd8a38-15d4-4f09-81d8-1fbad5f10ef5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.224920 Aug 02 09:02:42.261132 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 361/724] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:42 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:42.331097 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cf8f3a7a-8843-4e6f-8b3e-a8bad7942f79 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:42.332101 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-cf8f3a7a-8843-4e6f-8b3e-a8bad7942f79 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:42.338865 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a7a-8843-4e6f-8b3e-a8bad7942f79 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:42.339633 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a7a-8843-4e6f-8b3e-a8bad7942f79 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:42.340448 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a7a-8843-4e6f-8b3e-a8bad7942f79 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:42.341193 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cf8f3a7a-8843-4e6f-8b3e-a8bad7942f79 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:42.499921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-cf8f3a7a-8843-4e6f-8b3e-a8bad7942f79 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:42.508376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-cf8f3a7a-8843-4e6f-8b3e-a8bad7942f79 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1561 microversion: 2.1 time: 0.181442 Aug 02 09:02:42.509472 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 364/725] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:02:42 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:43.283100 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:43.283960 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:43.290774 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:43.291306 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:43.292198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:43.292710 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:43.430939 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:43.439165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:43.441394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:43.442523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f97010fa-5a45-4909-98c7-bdc201e09c89 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.163450 Aug 02 09:02:43.443079 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 362/726] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:43 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:43.789690 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-88bb3c40-9e12-4bdb-8a76-d1f19cafecbe req-6bb5b622-fc19-4b90-82b8-8c2fe38e8dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3981c8ca-8909-4516-8813-e3a3cd71960b", "name": "network-vif-plugged", "status": "completed", "tag": "4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:43.807062 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-88bb3c40-9e12-4bdb-8a76-d1f19cafecbe req-6bb5b622-fc19-4b90-82b8-8c2fe38e8dde service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:43.807507 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-88bb3c40-9e12-4bdb-8a76-d1f19cafecbe req-6bb5b622-fc19-4b90-82b8-8c2fe38e8dde service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:43.821034 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-88bb3c40-9e12-4bdb-8a76-d1f19cafecbe req-6bb5b622-fc19-4b90-82b8-8c2fe38e8dde service nova] Creating event network-vif-plugged:4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55 for instance 3981c8ca-8909-4516-8813-e3a3cd71960b on hv-cinder-78729 Aug 02 09:02:43.826062 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-88bb3c40-9e12-4bdb-8a76-d1f19cafecbe req-6bb5b622-fc19-4b90-82b8-8c2fe38e8dde service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042123 Aug 02 09:02:43.826864 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 365/727] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:44.468356 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:44.469199 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:44.472161 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.478450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:44.478899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:44.479929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:44.480752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:44.614776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:44.622823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:44.624442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:44.625611 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c31f9470-b329-45bf-884a-6aa96986fcc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.162343 Aug 02 09:02:44.626168 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 363/728] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:44 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:45.649438 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:45.650063 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:45.651983 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=35 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.657618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:45.658100 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:45.658864 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:45.659301 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:45.792323 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:45.800146 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:45.802307 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:45.803537 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-54b44607-c4ab-4010-ac36-8e918e330155 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.158969 Aug 02 09:02:45.804090 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 366/729] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:45 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:46.826575 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:46.827185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:46.834126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:46.834575 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:46.835337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:46.835773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:46.968570 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:46.976467 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:46.977983 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:46.979137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d1d7a78e-02b0-47dd-9ee9-4a18464964f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.156620 Aug 02 09:02:46.979694 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 364/730] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:46 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:48.002580 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:48.003214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:48.011619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:48.012063 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:48.012851 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:48.013288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:48.140222 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:48.149065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:48.150561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:48.151711 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4d0340cc-be6d-4cb9-a962-2014e019d049 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.153059 Aug 02 09:02:48.152308 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 367/731] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:47 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:49.173851 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:49.174376 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:49.181286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:49.181795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:49.182549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:49.182981 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:49.314213 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:49.322851 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:49.324447 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:49.325603 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b8c02f0b-1616-4733-a083-8fad60a69916 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.155801 Aug 02 09:02:49.326166 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 365/732] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:49 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:50.348776 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:50.349389 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:50.355812 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:50.356298 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:50.357071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:50.357512 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:50.488043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:50.496514 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:50.498062 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:50.499216 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-91f2f0b6-e453-42f7-83e0-27af7d41cd06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.154444 Aug 02 09:02:50.499780 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 368/733] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:50 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:51.521653 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:51.522282 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:51.528738 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:51.529176 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:51.529926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:51.530356 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:51.657651 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:51.666084 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:51.667583 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:51.668759 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ff7a3b9f-d48f-4313-a7ff-b8164f591baa tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.151067 Aug 02 09:02:51.669314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 366/734] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:51 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:52.691911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:52.693144 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:52.699539 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:52.699992 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:52.700810 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:52.701252 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:52.829819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:52.838459 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:52.839951 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:52.841143 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0450f36c-15fc-4fb1-859b-302f6e5f9074 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1743 microversion: 2.20 time: 0.153205 Aug 02 09:02:52.841703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 369/735] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:52 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:53.864928 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:53.865607 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:53.880569 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:53.881016 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:53.882292 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:53.882734 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:54.014847 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:54.023374 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:54.024926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:54.026074 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8a0122bd-84cd-408d-900f-7c9859a3f81a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1743 microversion: 2.20 time: 0.165669 Aug 02 09:02:54.026622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 367/736] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:53 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:55.048936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:55.049523 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:55.056050 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:55.056610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:55.057415 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:55.057845 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:55.188072 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:55.198444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:55.199949 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:55.201131 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ae7bd8c5-eeff-4816-b5a8-dcdc31e92931 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1743 microversion: 2.20 time: 0.156136 Aug 02 09:02:55.201691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 370/737] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:55 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:56.224961 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:56.225590 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:56.232103 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:56.232585 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:56.233355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:56.233793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:56.362553 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:56.371076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:56.372664 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:56.373864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7ca25b7e-eb98-49ec-91bc-88826aa85f5a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1743 microversion: 2.20 time: 0.153377 Aug 02 09:02:56.374434 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 368/738] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:56 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:57.398442 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:57.398813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:57.404979 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:57.405427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:57.406190 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:57.406625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:57.534933 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:57.543468 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:57.545010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:57.546164 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6fe5e066-aabb-4c5d-8eba-d100024b3b53 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1743 microversion: 2.20 time: 0.152704 Aug 02 09:02:57.546725 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 371/739] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:57 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:57.945501 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-3944aa7a-cbb0-482b-a03b-2df2f4909141 req-92261991-4f5a-4726-97da-a39035f4bc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1276a55d-d8fd-439c-abd7-16eeb8c44304", "name": "network-vif-plugged", "status": "completed", "tag": "e7195430-61af-498a-b128-9ae974ec3d07"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:57.955845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-3944aa7a-cbb0-482b-a03b-2df2f4909141 req-92261991-4f5a-4726-97da-a39035f4bc36 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:57.956394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-3944aa7a-cbb0-482b-a03b-2df2f4909141 req-92261991-4f5a-4726-97da-a39035f4bc36 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:57.968522 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-3944aa7a-cbb0-482b-a03b-2df2f4909141 req-92261991-4f5a-4726-97da-a39035f4bc36 service nova] Creating event network-vif-plugged:e7195430-61af-498a-b128-9ae974ec3d07 for instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 on hv-cinder-78729 Aug 02 09:02:57.973479 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-3944aa7a-cbb0-482b-a03b-2df2f4909141 req-92261991-4f5a-4726-97da-a39035f4bc36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032238 Aug 02 09:02:57.974102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 369/740] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:58.569980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:58.570645 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:58.579083 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:58.579539 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:58.580340 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:58.580782 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:58.711185 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:58.719469 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:58.721166 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:58.722163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b5674267-1c0f-49c5-b023-438c3d6e4d7a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1743 microversion: 2.20 time: 0.156630 Aug 02 09:02:58.723019 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 372/741] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:58 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:59.747362 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:59.748776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:02:59.755980 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:59.756468 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:59.757249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:59.757692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:59.899997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:59.909722 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:59.912485 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:02:59.919823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-cbc42a93-0bf1-4b71-b54c-8807330d4719 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.177358 Aug 02 09:02:59.924786 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 370/742] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:02:59 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:00.952585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:00.953186 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:00.961348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:00.962044 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:00.963204 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:00.963863 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:01.127326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:01.135716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:01.137420 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:01.138592 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-901eedb4-280a-4f17-92cb-4837935d69b2 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.189982 Aug 02 09:03:01.139143 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 373/743] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:00 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:02.163170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:02.163798 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:02.170903 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:02.171368 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:02.172164 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:02.172608 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:02.322702 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:02.331551 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:02.333358 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:02.334601 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-db26bc3f-96ef-4f48-b31c-82c061e80d67 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.175807 Aug 02 09:03:02.352438 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 371/744] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:02 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:03.368147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:03.369380 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:03.376175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:03.376630 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:03.377412 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:03.377846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:03.515869 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:03.525542 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:03.526580 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:03.527896 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7ca2dd93-eb7a-40c8-bacb-dc860289acc7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.164516 Aug 02 09:03:03.544399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 374/745] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:03 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:04.551098 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:04.552443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:04.559251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:04.559718 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:04.560516 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:04.560958 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:04.714696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:04.724562 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:04.726956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:04.728189 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f3ef58b8-8d26-4a1e-9ced-25021e947b65 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.181245 Aug 02 09:03:04.728760 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 372/746] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:04 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:05.753617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:05.754228 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:05.761189 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:05.761711 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:05.762563 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:05.763005 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:05.924203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:05.932984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:05.934516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:05.936079 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b9e475ed-2afe-4e8d-ae4f-d51631880c16 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.185918 Aug 02 09:03:05.936737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 375/747] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:05 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:06.963230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:06.963869 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:06.970513 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:06.970952 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:06.971833 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:06.972307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:07.391855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:07.401284 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:07.402822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:07.404015 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6469733b-ab32-4c52-a1d8-eafb02a1d918 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.447815 Aug 02 09:03:07.405241 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 373/748] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:06 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:08.427414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:08.428043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:08.434798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:08.435166 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:08.435957 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:08.436437 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:08.582083 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:08.594926 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:08.596445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:08.597593 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-2b6039f3-4ebc-41ba-81ec-5ca5bedab552 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.174237 Aug 02 09:03:08.598571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 376/749] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:08 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:09.620499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:09.621040 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:09.627685 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:09.628156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:09.628901 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:09.629947 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:09.757248 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:09.765078 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:09.766568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:09.767702 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c6495545-7b7c-4665-84c4-dffb842bc9b9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1738 microversion: 2.20 time: 0.151192 Aug 02 09:03:09.768281 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 374/750] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:09 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:10.204817 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-62dc1a81-c74a-43d3-946e-8d28bff81c74 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:10.205393 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-62dc1a81-c74a-43d3-946e-8d28bff81c74 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:10.212427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-62dc1a81-c74a-43d3-946e-8d28bff81c74 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:10.212884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-62dc1a81-c74a-43d3-946e-8d28bff81c74 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:10.213653 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-62dc1a81-c74a-43d3-946e-8d28bff81c74 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:10.214126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-62dc1a81-c74a-43d3-946e-8d28bff81c74 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:10.219316 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5be13add-efeb-47b5-8e44-829de5fcf6a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:10.219813 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5be13add-efeb-47b5-8e44-829de5fcf6a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:10.226003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5be13add-efeb-47b5-8e44-829de5fcf6a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:10.226458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5be13add-efeb-47b5-8e44-829de5fcf6a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:10.227328 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5be13add-efeb-47b5-8e44-829de5fcf6a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:10.227773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5be13add-efeb-47b5-8e44-829de5fcf6a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:10.239543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-62dc1a81-c74a-43d3-946e-8d28bff81c74 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/ips" status: 200 len: 145 microversion: 2.1 time: 0.038106 Aug 02 09:03:10.240135 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 377/751] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 09:03:10 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:10.251445 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5be13add-efeb-47b5-8e44-829de5fcf6a3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/ips" status: 200 len: 149 microversion: 2.1 time: 0.036078 Aug 02 09:03:10.253865 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 375/752] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 09:03:10 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:10.792145 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:10.792696 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:10.804211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:10.804211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:10.804211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:10.804211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:10.930490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:10.938330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:10.939845 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:10.941039 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e5a96846-1420-4d9d-b93e-c82bdd0cd152 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1720 microversion: 2.20 time: 0.152913 Aug 02 09:03:10.941629 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 378/753] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:10 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:11.622087 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8f60dd5a-7e24-4462-8aa9-b84a18ac99ee tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656f90ae-2aea-48e4-89d9-a1db4633318f"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:11.624474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8f60dd5a-7e24-4462-8aa9-b84a18ac99ee tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:11.631240 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8f60dd5a-7e24-4462-8aa9-b84a18ac99ee tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:11.631697 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8f60dd5a-7e24-4462-8aa9-b84a18ac99ee tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:11.632493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8f60dd5a-7e24-4462-8aa9-b84a18ac99ee tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:11.632931 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8f60dd5a-7e24-4462-8aa9-b84a18ac99ee tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:11.635419 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=87 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:11.964655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:11.965175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:11.971666 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:11.972112 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:11.972918 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:11.973856 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:11.977707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=87 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:12.120047 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:12.128041 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:12.129683 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:12.130951 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-407220cb-1afa-4cb5-ac13-b5bde338537a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1720 microversion: 2.20 time: 0.170237 Aug 02 09:03:12.131504 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 379/754] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:11 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:03:12.560599 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8f60dd5a-7e24-4462-8aa9-b84a18ac99ee tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942224 Aug 02 09:03:12.561211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 376/755] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 09:03:11 2022] POST /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments => generated 194 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:03:12.702812 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d3f30364-bdd2-4fec-92e6-9c36a7e0dfb0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6e3f0d-fe46-4240-a330-91ec03eb6d0f"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:12.705978 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d3f30364-bdd2-4fec-92e6-9c36a7e0dfb0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:12.713371 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3f30364-bdd2-4fec-92e6-9c36a7e0dfb0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:12.713629 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3f30364-bdd2-4fec-92e6-9c36a7e0dfb0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:12.714505 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3f30364-bdd2-4fec-92e6-9c36a7e0dfb0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:12.715187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3f30364-bdd2-4fec-92e6-9c36a7e0dfb0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:13.155756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:13.156496 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:13.162868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:13.163314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:13.164076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:13.164546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:13.195545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d3f30364-bdd2-4fec-92e6-9c36a7e0dfb0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496463 Aug 02 09:03:13.196493 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 380/756] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 09:03:12 2022] POST /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:13.307265 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:13.315243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:13.316786 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:13.318502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4e9e927d-7468-4526-8111-2a078d35c3a9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1663 microversion: 2.20 time: 0.167837 Aug 02 09:03:13.319048 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 377/757] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:13 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:13.342257 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fb514fd4-be14-4bbd-9993-fe3800cc0c72 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69bd59ff-ecd8-40be-b5ee-732eb5c3823c"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:13.344790 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fb514fd4-be14-4bbd-9993-fe3800cc0c72 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:13.351518 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fb514fd4-be14-4bbd-9993-fe3800cc0c72 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:13.351969 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fb514fd4-be14-4bbd-9993-fe3800cc0c72 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:13.352771 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fb514fd4-be14-4bbd-9993-fe3800cc0c72 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:13.353212 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fb514fd4-be14-4bbd-9993-fe3800cc0c72 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:13.623036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fb514fd4-be14-4bbd-9993-fe3800cc0c72 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285550 Aug 02 09:03:13.623737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 381/758] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Aug 2 09:03:13 2022] POST /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:13.754249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b141c075-05b0-4a40-ad00-303d5d7e6cd6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:13.755567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b141c075-05b0-4a40-ad00-303d5d7e6cd6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:13.764803 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b141c075-05b0-4a40-ad00-303d5d7e6cd6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:13.765467 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b141c075-05b0-4a40-ad00-303d5d7e6cd6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:13.766638 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b141c075-05b0-4a40-ad00-303d5d7e6cd6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:13.767271 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b141c075-05b0-4a40-ad00-303d5d7e6cd6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:13.965474 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-059ea8c7-e207-4592-842e-3a06f1b4b461 req-12abf1ac-62d4-48ca-a53c-a27b470ec740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1276a55d-d8fd-439c-abd7-16eeb8c44304", "name": "network-vif-unplugged", "status": "completed", "tag": "e7195430-61af-498a-b128-9ae974ec3d07"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:13.977234 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-059ea8c7-e207-4592-842e-3a06f1b4b461 req-12abf1ac-62d4-48ca-a53c-a27b470ec740 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:13.977686 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-059ea8c7-e207-4592-842e-3a06f1b4b461 req-12abf1ac-62d4-48ca-a53c-a27b470ec740 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:13.989751 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.compute.server_external_events [req-059ea8c7-e207-4592-842e-3a06f1b4b461 req-12abf1ac-62d4-48ca-a53c-a27b470ec740 service nova] Unable to find a host for instance 1276a55d-d8fd-439c-abd7-16eeb8c44304. Dropping event network-vif-unplugged {{(pid=117773) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 09:03:13.990649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-059ea8c7-e207-4592-842e-3a06f1b4b461 req-12abf1ac-62d4-48ca-a53c-a27b470ec740 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030418 Aug 02 09:03:13.991410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 382/759] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 02 09:03:14.027430 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b141c075-05b0-4a40-ad00-303d5d7e6cd6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/os-volume_attachments/69bd59ff-ecd8-40be-b5ee-732eb5c3823c" status: 202 len: 0 microversion: 2.20 time: 0.279404 Aug 02 09:03:14.031301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 378/760] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Aug 2 09:03:13 2022] DELETE /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/os-volume_attachments/69bd59ff-ecd8-40be-b5ee-732eb5c3823c => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:14.086687 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-9280e8bc-a77a-4b5b-9c96-26a850190157 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:14.087287 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9280e8bc-a77a-4b5b-9c96-26a850190157 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:14.093274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9280e8bc-a77a-4b5b-9c96-26a850190157 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:14.093721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9280e8bc-a77a-4b5b-9c96-26a850190157 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:14.094516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9280e8bc-a77a-4b5b-9c96-26a850190157 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:14.094953 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-9280e8bc-a77a-4b5b-9c96-26a850190157 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:14.137374 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-9280e8bc-a77a-4b5b-9c96-26a850190157 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117773) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:03:14.203089 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-9280e8bc-a77a-4b5b-9c96-26a850190157 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "POST /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/action" status: 202 len: 0 microversion: 2.20 time: 0.121025 Aug 02 09:03:14.203834 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 383/761] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 2 09:03:14 2022] POST /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:14.212743 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:14.213464 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:14.220376 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:14.220901 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:14.221745 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:14.222259 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:14.356959 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:14.364956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:14.366464 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:14.367644 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-405d8985-3762-49a1-9e78-3c142f4acb07 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1671 microversion: 2.20 time: 0.158885 Aug 02 09:03:14.368311 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 379/762] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:14 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:15.391211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:15.392022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:15.398756 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:15.399204 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:15.399974 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:15.400441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:15.549883 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:15.558449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:15.559954 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:15.561177 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f7fa5e64-9c8e-4e21-8455-21c3d82303ef tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1673 microversion: 2.20 time: 0.174335 Aug 02 09:03:15.561767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 384/763] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:15 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:16.583759 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:16.584570 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:16.587066 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=34 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:16.592502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:16.592949 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:16.593717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:16.594277 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:16.730115 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:16.738072 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:16.739672 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:16.740896 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4abce5d0-dfdb-4796-b743-a8aa90c38763 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.161282 Aug 02 09:03:16.741476 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 380/764] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:16 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:17.764643 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:17.765267 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:17.767656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.773410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:17.773859 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:17.775076 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:17.775525 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:18.092373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:18.101365 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:18.103215 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:18.104487 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ca1991a0-f6cf-4faf-86eb-bc6ebe13a141 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.343802 Aug 02 09:03:18.105112 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 385/765] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:17 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:19.128345 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:19.128955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:19.136479 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:19.136924 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:19.137675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:19.138104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:19.271295 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:19.279025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:19.280548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:19.281714 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-513e3493-816a-46e7-a87b-f59b364c3a90 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.157326 Aug 02 09:03:19.282295 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 381/766] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:19 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:20.306658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:20.307209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:20.313913 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:20.315341 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:20.316201 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:20.316655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:20.455533 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:20.465129 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:20.466638 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:20.468014 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3ea37c63-90ba-4b66-9be2-bec1b3df53e9 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.165878 Aug 02 09:03:20.468617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 386/767] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:20 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:21.492448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:21.493101 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:21.500104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:21.500583 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:21.501372 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:21.501815 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:21.641775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:21.650304 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:21.651819 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:21.652997 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-49abc9f2-13af-4d88-8eec-401ca1a267b1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.165618 Aug 02 09:03:21.653547 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 382/768] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:21 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:22.676662 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:22.677940 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:22.685035 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:22.685483 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:22.686425 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:22.686925 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:22.842415 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:22.852847 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:22.854334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:22.855484 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b3449806-97a0-45ad-b3b7-b4ebe5e8e5af tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.182670 Aug 02 09:03:22.856018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 387/769] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:22 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:23.879096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:23.879742 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:23.886436 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:23.886886 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:23.887648 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:23.888087 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:24.020712 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:24.028802 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:24.030350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:24.031525 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c6b04b90-a2e2-48e6-a894-712abf4e1587 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.156597 Aug 02 09:03:24.032433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 383/770] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:23 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:25.055454 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:25.056015 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:25.063608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:25.064061 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:25.064872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:25.065314 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:25.216756 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:25.225141 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:25.226665 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:25.227837 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c11b5ba2-f628-4fc1-9753-6e9836a3a246 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.176891 Aug 02 09:03:25.238371 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 388/771] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:25 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:26.261909 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:26.262761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:26.270286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:26.270761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:26.272152 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:26.277991 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:26.419922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:26.428208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:26.429724 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:26.431487 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a772b099-2676-4eb8-9285-b5fe665c3c82 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.180680 Aug 02 09:03:26.432354 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 384/772] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:26 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:27.455351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:27.455966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:27.463826 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:27.464319 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:27.465099 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:27.465540 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:27.596982 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:27.604857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:27.606367 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:27.607542 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d1b80181-ee7d-4bea-b716-779dcff40a21 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.156236 Aug 02 09:03:27.608096 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 389/773] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:27 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:28.630662 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:28.631208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:28.638349 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:28.638804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:28.639573 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:28.640000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:28.771247 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:28.779541 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:28.781064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:28.782216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d68efad3-4d08-4b3a-a863-6377baf6fe4f tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.155566 Aug 02 09:03:28.782773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 385/774] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:28 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:29.806183 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:29.806600 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:29.813158 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:29.813602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:29.814366 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:29.814871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:29.940660 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:29.948989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:29.950501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:29.951639 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-73260cf9-a6e8-49a9-8a92-01f0eea987de tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.149514 Aug 02 09:03:29.952207 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 390/775] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:29 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:30.975496 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:30.976029 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:30.983176 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:30.983651 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:30.984445 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:30.984880 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:31.115496 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:31.124279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:31.126507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:31.127665 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0425dcdc-c599-4a86-ab37-b66e277a98f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.156201 Aug 02 09:03:31.128257 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 386/776] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:30 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:32.156035 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:32.156707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:32.163230 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:32.163741 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:32.164466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:32.165386 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:32.179654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.302721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:32.313551 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:32.315075 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:32.316554 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-805c7a78-fe7c-47ab-b49c-ba99973c65fd tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.164305 Aug 02 09:03:32.325181 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 391/777] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:32 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:32.869832 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ad870387-3a0f-495d-87ec-b07aade784b3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:32.872179 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ad870387-3a0f-495d-87ec-b07aade784b3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:32.878840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ad870387-3a0f-495d-87ec-b07aade784b3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:32.879293 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ad870387-3a0f-495d-87ec-b07aade784b3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:32.880223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ad870387-3a0f-495d-87ec-b07aade784b3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:32.880535 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ad870387-3a0f-495d-87ec-b07aade784b3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:32.910474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ad870387-3a0f-495d-87ec-b07aade784b3 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Aug 02 09:03:32.911031 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 387/778] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:32 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:32.921691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ad7c640b-ab00-48f2-9db5-6e158d4213ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:32.922182 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ad7c640b-ab00-48f2-9db5-6e158d4213ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:32.928221 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ad7c640b-ab00-48f2-9db5-6e158d4213ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:32.928670 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ad7c640b-ab00-48f2-9db5-6e158d4213ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:32.929433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ad7c640b-ab00-48f2-9db5-6e158d4213ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:32.929865 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ad7c640b-ab00-48f2-9db5-6e158d4213ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:32.957911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ad7c640b-ab00-48f2-9db5-6e158d4213ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/656f90ae-2aea-48e4-89d9-a1db4633318f" status: 200 len: 194 microversion: 2.1 time: 0.040140 Aug 02 09:03:32.958481 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 392/779] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 2 09:03:32 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/656f90ae-2aea-48e4-89d9-a1db4633318f => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:33.339987 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:33.340618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:33.346809 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:33.347271 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:33.348028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:33.348720 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:33.487119 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:33.497579 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.501217 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:33.502664 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:33.504534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-215b4c46-8bfe-4bb2-a76a-4eceda5b8dc1 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.168638 Aug 02 09:03:33.505292 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 388/780] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:33 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:34.281709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e4086f33-3f36-40a1-866f-4b1fd4b9a067 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50aaca1b-9e5f-4f73-838c-e4f888e75571"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:34.284083 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e4086f33-3f36-40a1-866f-4b1fd4b9a067 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:34.290481 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e4086f33-3f36-40a1-866f-4b1fd4b9a067 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:34.290945 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e4086f33-3f36-40a1-866f-4b1fd4b9a067 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:34.291685 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e4086f33-3f36-40a1-866f-4b1fd4b9a067 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:34.292137 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e4086f33-3f36-40a1-866f-4b1fd4b9a067 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:34.527880 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:34.528517 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:34.537611 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:34.538059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:34.538843 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:34.539381 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:34.695719 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:34.704660 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:34.706443 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:34.707910 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-593e8f70-611e-497c-a19f-4f0fb641ffd7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.184404 Aug 02 09:03:34.708771 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 389/781] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:34 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:03:34.727127 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e4086f33-3f36-40a1-866f-4b1fd4b9a067 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "POST /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449079 Aug 02 09:03:34.727941 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 393/782] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 09:03:34 2022] POST /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:03:35.734226 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:35.734793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:35.741315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:35.741771 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:35.742540 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:35.743000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:35.872009 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:35.879977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:35.881516 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:35.882658 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-89bf1571-431e-4ed3-a82f-24a09fde9fca tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.152371 Aug 02 09:03:35.883221 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 390/783] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:35 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:36.091655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-02b49354-5eb7-4158-a513-7ac3760a0d7c req-0d1aff94-348b-4015-aa3a-d22b01faa8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1276a55d-d8fd-439c-abd7-16eeb8c44304", "name": "network-vif-plugged", "status": "completed", "tag": "e7195430-61af-498a-b128-9ae974ec3d07"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:36.101789 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-02b49354-5eb7-4158-a513-7ac3760a0d7c req-0d1aff94-348b-4015-aa3a-d22b01faa8b4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:36.102336 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-02b49354-5eb7-4158-a513-7ac3760a0d7c req-0d1aff94-348b-4015-aa3a-d22b01faa8b4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:36.114300 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-02b49354-5eb7-4158-a513-7ac3760a0d7c req-0d1aff94-348b-4015-aa3a-d22b01faa8b4 service nova] Creating event network-vif-plugged:e7195430-61af-498a-b128-9ae974ec3d07 for instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 on hv-cinder-78729 Aug 02 09:03:36.119611 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-02b49354-5eb7-4158-a513-7ac3760a0d7c req-0d1aff94-348b-4015-aa3a-d22b01faa8b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Aug 02 09:03:36.120493 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 394/784] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:36.906235 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:36.906841 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:36.913305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:36.913747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:36.914503 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:36.915574 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:37.095898 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:37.104523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:37.106015 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:37.107152 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4c939c9d-212e-4fb8-a3ea-78faea9403bf tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.204800 Aug 02 09:03:37.107709 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 391/785] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:36 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:38.130768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:38.131473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:38.139480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:38.140260 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:38.141381 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:38.141826 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:38.331136 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:38.339753 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:38.341303 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:38.342766 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-48ca7324-bcf5-447e-b9a9-2b6fa2cb089a tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1729 microversion: 2.20 time: 0.216127 Aug 02 09:03:38.343321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 395/786] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:38 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:39.503167 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:39.503773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:39.509899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:39.510352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:39.511110 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:39.511573 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:39.642929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:39.651738 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:39.653293 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:39.654437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f48f93b1-13b0-4747-8a28-02970d0eaab4 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1716 microversion: 2.20 time: 0.291495 Aug 02 09:03:39.654987 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 392/787] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:03:39 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1716 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:39.675064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:03:39.675275 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 09:03:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:03:39.970819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6e3f0d-fe46-4240-a330-91ec03eb6d0f"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:39.973246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:39.979672 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:39.980138 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:39.980900 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:39.981332 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:40.058190 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Invalid volume: volume 9b6e3f0d-fe46-4240-a330-91ec03eb6d0f is already attached to instances: 4168c7d4-9466-4939-8905-6e4eb6efa7c4 Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: POST /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments HTTP/1.1 Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 74 Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:03:40.059948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {"volumeAttachment": {"volumeId": "9b6e3f0d-fe46-4240-a330-91ec03eb6d0f"}} Aug 02 09:03:40.061534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Invalid volume: volume 9b6e3f0d-fe46-4240-a330-91ec03eb6d0f is already attached to instances: 4168c7d4-9466-4939-8905-6e4eb6efa7c4 Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'server_id': '4168c7d4-9466-4939-8905-6e4eb6efa7c4', 'body': {'volumeAttachment': {'volumeId': '9b6e3f0d-fe46-4240-a330-91ec03eb6d0f'}}} Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9b6e3f0d-fe46-4240-a330-91ec03eb6d0f is already attached to instances: 4168c7d4-9466-4939-8905-6e4eb6efa7c4 Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:40.062349 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9b6e3f0d-fe46-4240-a330-91ec03eb6d0f is already attached to instances: 4168c7d4-9466-4939-8905-6e4eb6efa7c4 Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:40.063740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:40.065844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:40.065844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:40.065844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:40.065844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9b6e3f0d-fe46-4240-a330-91ec03eb6d0f is already attached to instances: 4168c7d4-9466-4939-8905-6e4eb6efa7c4 Aug 02 09:03:40.065844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:40.065844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 400 to user: Invalid volume: volume 9b6e3f0d-fe46-4240-a330-91ec03eb6d0f is already attached to instances: 4168c7d4-9466-4939-8905-6e4eb6efa7c4 {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:40.065844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c5bb77a2-9ad0-44aa-b83d-65a3a9155cf3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094574 Aug 02 09:03:40.065844 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 396/788] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 09:03:39 2022] POST /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:03:40.147686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6c3bb206-b049-400c-9299-80ffe97c8132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:40.148113 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6c3bb206-b049-400c-9299-80ffe97c8132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:40.154097 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c3bb206-b049-400c-9299-80ffe97c8132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:40.154545 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c3bb206-b049-400c-9299-80ffe97c8132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:40.155305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c3bb206-b049-400c-9299-80ffe97c8132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:40.155741 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6c3bb206-b049-400c-9299-80ffe97c8132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:40.239323 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-6c3bb206-b049-400c-9299-80ffe97c8132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lazy-loading 'services' on Instance uuid 4168c7d4-9466-4939-8905-6e4eb6efa7c4 {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:03:40.313697 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6c3bb206-b049-400c-9299-80ffe97c8132 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments/9b6e3f0d-fe46-4240-a330-91ec03eb6d0f" status: 202 len: 0 microversion: 2.1 time: 0.169557 Aug 02 09:03:40.314276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 393/789] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 09:03:40 2022] DELETE /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments/9b6e3f0d-fe46-4240-a330-91ec03eb6d0f => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:03:40.329269 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-cdcd316b-d682-4927-b67c-4b3b3590f08c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:40.332528 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-cdcd316b-d682-4927-b67c-4b3b3590f08c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:40.339652 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cdcd316b-d682-4927-b67c-4b3b3590f08c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:40.340103 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cdcd316b-d682-4927-b67c-4b3b3590f08c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:40.340913 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cdcd316b-d682-4927-b67c-4b3b3590f08c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:40.341360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-cdcd316b-d682-4927-b67c-4b3b3590f08c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:40.371996 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-cdcd316b-d682-4927-b67c-4b3b3590f08c tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046827 Aug 02 09:03:40.372566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 397/790] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:40 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:41.384667 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-325b1b7d-272a-43b0-b805-d4fd9822a7f8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:41.387081 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-325b1b7d-272a-43b0-b805-d4fd9822a7f8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:41.393512 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-325b1b7d-272a-43b0-b805-d4fd9822a7f8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:41.393962 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-325b1b7d-272a-43b0-b805-d4fd9822a7f8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:41.394752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-325b1b7d-272a-43b0-b805-d4fd9822a7f8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:41.395187 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-325b1b7d-272a-43b0-b805-d4fd9822a7f8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:41.425565 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-325b1b7d-272a-43b0-b805-d4fd9822a7f8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Aug 02 09:03:41.430305 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 394/791] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:41 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:42.437334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-34e46417-4f7a-441d-8776-96c061a978bc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:42.439427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-34e46417-4f7a-441d-8776-96c061a978bc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:42.446067 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-34e46417-4f7a-441d-8776-96c061a978bc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:42.446515 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-34e46417-4f7a-441d-8776-96c061a978bc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:42.447280 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-34e46417-4f7a-441d-8776-96c061a978bc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:42.447714 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-34e46417-4f7a-441d-8776-96c061a978bc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:42.476702 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-34e46417-4f7a-441d-8776-96c061a978bc tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043402 Aug 02 09:03:42.477903 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 398/792] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:42 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:43.490687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-dc896d58-1676-40da-abf9-b06ba5898c93 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:43.493105 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-dc896d58-1676-40da-abf9-b06ba5898c93 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:43.501313 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc896d58-1676-40da-abf9-b06ba5898c93 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:43.501786 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc896d58-1676-40da-abf9-b06ba5898c93 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:43.502546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc896d58-1676-40da-abf9-b06ba5898c93 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:43.502974 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc896d58-1676-40da-abf9-b06ba5898c93 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:43.531714 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-dc896d58-1676-40da-abf9-b06ba5898c93 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Aug 02 09:03:43.533342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 395/793] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:43 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:44.544795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-52975994-bac8-42ca-a4f8-409f3bee0f90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:44.546932 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-52975994-bac8-42ca-a4f8-409f3bee0f90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:44.553456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-52975994-bac8-42ca-a4f8-409f3bee0f90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:44.553908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-52975994-bac8-42ca-a4f8-409f3bee0f90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:44.554674 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-52975994-bac8-42ca-a4f8-409f3bee0f90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:44.555132 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-52975994-bac8-42ca-a4f8-409f3bee0f90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:44.583488 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-52975994-bac8-42ca-a4f8-409f3bee0f90 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042644 Aug 02 09:03:44.584034 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 399/794] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:44 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:45.596007 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7b3ba10d-4392-404a-8800-61634317321b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:45.598205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7b3ba10d-4392-404a-8800-61634317321b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:45.605159 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7b3ba10d-4392-404a-8800-61634317321b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:45.605583 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7b3ba10d-4392-404a-8800-61634317321b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:45.606335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7b3ba10d-4392-404a-8800-61634317321b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:45.606764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7b3ba10d-4392-404a-8800-61634317321b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:45.635144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7b3ba10d-4392-404a-8800-61634317321b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Aug 02 09:03:45.635679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 396/795] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:45 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:46.647147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6fb80922-3690-48d9-90c2-aab4e995a33f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:46.649753 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6fb80922-3690-48d9-90c2-aab4e995a33f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:46.656243 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6fb80922-3690-48d9-90c2-aab4e995a33f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:46.656699 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6fb80922-3690-48d9-90c2-aab4e995a33f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:46.657489 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6fb80922-3690-48d9-90c2-aab4e995a33f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:46.657928 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6fb80922-3690-48d9-90c2-aab4e995a33f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:46.688078 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6fb80922-3690-48d9-90c2-aab4e995a33f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Aug 02 09:03:46.688654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 400/796] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:46 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:47.556286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-251354d1-ba4d-48ec-acff-8a76a0417bda tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:47.558412 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-251354d1-ba4d-48ec-acff-8a76a0417bda tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:47.560849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=34 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:47.566552 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-251354d1-ba4d-48ec-acff-8a76a0417bda tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.567010 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-251354d1-ba4d-48ec-acff-8a76a0417bda tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.568066 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-251354d1-ba4d-48ec-acff-8a76a0417bda tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.568537 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-251354d1-ba4d-48ec-acff-8a76a0417bda tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.598498 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-251354d1-ba4d-48ec-acff-8a76a0417bda tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046474 Aug 02 09:03:47.599067 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 397/797] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:47 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:47.700385 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-80ad3293-b55e-418a-a502-d5e11ca28c18 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:47.702566 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-80ad3293-b55e-418a-a502-d5e11ca28c18 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:47.709813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-80ad3293-b55e-418a-a502-d5e11ca28c18 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.710256 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-80ad3293-b55e-418a-a502-d5e11ca28c18 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.711718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-80ad3293-b55e-418a-a502-d5e11ca28c18 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.712181 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-80ad3293-b55e-418a-a502-d5e11ca28c18 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.737551 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-26cdad1d-3d1e-4741-bcf1-e3a81e59514c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:47.738057 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-26cdad1d-3d1e-4741-bcf1-e3a81e59514c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:47.741487 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-80ad3293-b55e-418a-a502-d5e11ca28c18 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045071 Aug 02 09:03:47.742039 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 401/798] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:47 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:03:47.744077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26cdad1d-3d1e-4741-bcf1-e3a81e59514c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.744556 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26cdad1d-3d1e-4741-bcf1-e3a81e59514c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.745315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26cdad1d-3d1e-4741-bcf1-e3a81e59514c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.745861 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26cdad1d-3d1e-4741-bcf1-e3a81e59514c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.776187 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-26cdad1d-3d1e-4741-bcf1-e3a81e59514c tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/656f90ae-2aea-48e4-89d9-a1db4633318f" status: 200 len: 194 microversion: 2.1 time: 0.042439 Aug 02 09:03:47.776792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 398/799] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 2 09:03:47 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/656f90ae-2aea-48e4-89d9-a1db4633318f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:03:47.787088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e9cfc148-e161-4e21-8186-bd5df827bd5b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:47.787596 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e9cfc148-e161-4e21-8186-bd5df827bd5b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:47.789658 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=34 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:47.794558 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e9cfc148-e161-4e21-8186-bd5df827bd5b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.795016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e9cfc148-e161-4e21-8186-bd5df827bd5b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.795794 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e9cfc148-e161-4e21-8186-bd5df827bd5b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.796264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e9cfc148-e161-4e21-8186-bd5df827bd5b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.811964 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-446aa13d-6b43-4f1c-a66a-914fa37fb43d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:47.812672 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-446aa13d-6b43-4f1c-a66a-914fa37fb43d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:47.818827 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-446aa13d-6b43-4f1c-a66a-914fa37fb43d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.819212 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-446aa13d-6b43-4f1c-a66a-914fa37fb43d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.819979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-446aa13d-6b43-4f1c-a66a-914fa37fb43d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.820954 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-446aa13d-6b43-4f1c-a66a-914fa37fb43d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.848144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-446aa13d-6b43-4f1c-a66a-914fa37fb43d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:03:47.877328 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-e9cfc148-e161-4e21-8186-bd5df827bd5b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lazy-loading 'services' on Instance uuid b0294f72-846b-4b03-8c91-063f464f63ae {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:03:47.926915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-446aa13d-6b43-4f1c-a66a-914fa37fb43d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 204 len: 0 microversion: 2.1 time: 0.118048 Aug 02 09:03:47.927749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 399/800] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:03:47 2022] DELETE /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:47.937748 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-42b14dd1-7fd8-4d53-80a0-18e38aef3593 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:47.938499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-42b14dd1-7fd8-4d53-80a0-18e38aef3593 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:47.944936 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-42b14dd1-7fd8-4d53-80a0-18e38aef3593 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.946009 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-42b14dd1-7fd8-4d53-80a0-18e38aef3593 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.946806 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-42b14dd1-7fd8-4d53-80a0-18e38aef3593 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:47.947339 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-42b14dd1-7fd8-4d53-80a0-18e38aef3593 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:47.953796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e9cfc148-e161-4e21-8186-bd5df827bd5b tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/656f90ae-2aea-48e4-89d9-a1db4633318f" status: 202 len: 0 microversion: 2.1 time: 0.170419 Aug 02 09:03:47.954398 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 402/801] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 09:03:47 2022] DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/656f90ae-2aea-48e4-89d9-a1db4633318f => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:03:48.088567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-42b14dd1-7fd8-4d53-80a0-18e38aef3593 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:48.095963 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-42b14dd1-7fd8-4d53-80a0-18e38aef3593 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1680 microversion: 2.1 time: 0.163673 Aug 02 09:03:48.096570 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 400/802] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:47 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:49.118457 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-71fe5b29-f4f0-4b7a-a65f-76802436b7fa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:49.119155 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-71fe5b29-f4f0-4b7a-a65f-76802436b7fa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:49.125348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-71fe5b29-f4f0-4b7a-a65f-76802436b7fa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:49.125796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-71fe5b29-f4f0-4b7a-a65f-76802436b7fa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:49.126564 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-71fe5b29-f4f0-4b7a-a65f-76802436b7fa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:49.126998 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-71fe5b29-f4f0-4b7a-a65f-76802436b7fa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:49.260516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-71fe5b29-f4f0-4b7a-a65f-76802436b7fa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:49.268071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-71fe5b29-f4f0-4b7a-a65f-76802436b7fa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1680 microversion: 2.1 time: 0.154723 Aug 02 09:03:49.268605 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 403/803] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:49 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:50.289983 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-34562215-b4fd-4a98-87f4-5e943b4449d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:50.290598 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-34562215-b4fd-4a98-87f4-5e943b4449d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:50.297785 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-34562215-b4fd-4a98-87f4-5e943b4449d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:50.298277 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-34562215-b4fd-4a98-87f4-5e943b4449d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:50.299088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-34562215-b4fd-4a98-87f4-5e943b4449d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:50.299617 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-34562215-b4fd-4a98-87f4-5e943b4449d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:50.435217 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-34562215-b4fd-4a98-87f4-5e943b4449d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:50.442966 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-34562215-b4fd-4a98-87f4-5e943b4449d8 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1680 microversion: 2.1 time: 0.157571 Aug 02 09:03:50.443543 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 401/804] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:50 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:51.124238 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-40723c0f-52ff-4937-9a9b-c06489507477 req-fcd4f01b-5832-4990-b7fe-c2921c139316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4168c7d4-9466-4939-8905-6e4eb6efa7c4", "name": "network-vif-deleted", "tag": "8326a790-ccee-45b4-a712-473bad036556"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:51.134252 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-40723c0f-52ff-4937-9a9b-c06489507477 req-fcd4f01b-5832-4990-b7fe-c2921c139316 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:51.134689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-40723c0f-52ff-4937-9a9b-c06489507477 req-fcd4f01b-5832-4990-b7fe-c2921c139316 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:51.146004 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-40723c0f-52ff-4937-9a9b-c06489507477 req-fcd4f01b-5832-4990-b7fe-c2921c139316 service nova] Creating event network-vif-deleted:8326a790-ccee-45b4-a712-473bad036556 for instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 on hv-cinder-78729 Aug 02 09:03:51.151688 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-40723c0f-52ff-4937-9a9b-c06489507477 req-fcd4f01b-5832-4990-b7fe-c2921c139316 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Aug 02 09:03:51.152299 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 404/805] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:51.197973 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8b25faf1-ad2e-424b-b9f6-94f5278b6927 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:51.198473 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8b25faf1-ad2e-424b-b9f6-94f5278b6927 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:51.204963 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8b25faf1-ad2e-424b-b9f6-94f5278b6927 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:51.205382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8b25faf1-ad2e-424b-b9f6-94f5278b6927 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:51.206412 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8b25faf1-ad2e-424b-b9f6-94f5278b6927 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:51.207042 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8b25faf1-ad2e-424b-b9f6-94f5278b6927 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:51.244467 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8b25faf1-ad2e-424b-b9f6-94f5278b6927 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/50aaca1b-9e5f-4f73-838c-e4f888e75571" status: 200 len: 194 microversion: 2.1 time: 0.050487 Aug 02 09:03:51.256559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f374ea99-2c97-449f-9734-f73ed6911112 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:51.257400 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f374ea99-2c97-449f-9734-f73ed6911112 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:51.260577 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 402/806] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 2 09:03:51 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/50aaca1b-9e5f-4f73-838c-e4f888e75571 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:51.264060 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f374ea99-2c97-449f-9734-f73ed6911112 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:51.264771 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f374ea99-2c97-449f-9734-f73ed6911112 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:51.265568 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f374ea99-2c97-449f-9734-f73ed6911112 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:51.266007 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f374ea99-2c97-449f-9734-f73ed6911112 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:51.364871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-f374ea99-2c97-449f-9734-f73ed6911112 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lazy-loading 'services' on Instance uuid b0294f72-846b-4b03-8c91-063f464f63ae {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:03:51.440076 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f374ea99-2c97-449f-9734-f73ed6911112 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/50aaca1b-9e5f-4f73-838c-e4f888e75571" status: 202 len: 0 microversion: 2.1 time: 0.187801 Aug 02 09:03:51.440695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 405/807] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 09:03:51 2022] DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments/50aaca1b-9e5f-4f73-838c-e4f888e75571 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:03:51.466255 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:51.466795 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:51.473299 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:51.473752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:51.474526 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:51.474961 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:51.479920 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.522013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:51.522467 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:51.522912 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lazy-loading 'fault' on Instance uuid 4168c7d4-9466-4939-8905-6e4eb6efa7c4 {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:03:51.582703 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:51.591982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-84427760-b9c3-4258-8b4d-1655cf33e3ff tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 200 len: 1330 microversion: 2.1 time: 0.130746 Aug 02 09:03:51.592843 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 403/808] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:51 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:52.614734 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:52.615478 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:52.620982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-54db6234-7d5e-48b5-af13-d1959f642015 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:52.621868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:52.622325 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:52.623111 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:52.623276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-54db6234-7d5e-48b5-af13-d1959f642015 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:52.623554 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:52.629531 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-54db6234-7d5e-48b5-af13-d1959f642015 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:52.629973 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-54db6234-7d5e-48b5-af13-d1959f642015 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:52.630732 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-54db6234-7d5e-48b5-af13-d1959f642015 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:52.631160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-54db6234-7d5e-48b5-af13-d1959f642015 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:52.637123 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 HTTP/1.1 Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:03:52.638760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:03:52.640402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '4168c7d4-9466-4939-8905-6e4eb6efa7c4'} Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:52.641503 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:03:52.642746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:52.644473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:52.644473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b5615fca-07cc-4576-88ca-34291ad68280 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 404 len: 111 microversion: 2.1 time: 0.030298 Aug 02 09:03:52.644473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 406/809] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:52 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:03:52.649157 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-15b15a74-f109-4d16-b7b7-81440c49e26b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '.version_select at 0x7f13faa149d0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:52.660736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-54db6234-7d5e-48b5-af13-d1959f642015 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043862 Aug 02 09:03:52.661312 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 404/810] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:52 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 09:03:52.668185 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-15b15a74-f109-4d16-b7b7-81440c49e26b tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-431726767" status: 202 len: 0 microversion: 2.1 time: 0.022939 Aug 02 09:03:52.668898 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 407/811] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 2 09:03:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-431726767 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:03:52.781590 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f6f9f4b2-7ced-44b0-b0b8-6b30e222b1a1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:52.783823 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f6f9f4b2-7ced-44b0-b0b8-6b30e222b1a1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:52.790713 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f6f9f4b2-7ced-44b0-b0b8-6b30e222b1a1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:52.791233 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f6f9f4b2-7ced-44b0-b0b8-6b30e222b1a1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:52.792100 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f6f9f4b2-7ced-44b0-b0b8-6b30e222b1a1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:52.792619 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f6f9f4b2-7ced-44b0-b0b8-6b30e222b1a1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:52.827636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f6f9f4b2-7ced-44b0-b0b8-6b30e222b1a1 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049905 Aug 02 09:03:52.834484 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 405/812] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:03:52 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:03:52.896420 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-40c8ee02-75b1-40c6-95ba-5300b4baa811 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:52.896918 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-40c8ee02-75b1-40c6-95ba-5300b4baa811 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:52.904636 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-40c8ee02-75b1-40c6-95ba-5300b4baa811 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:52.905088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-40c8ee02-75b1-40c6-95ba-5300b4baa811 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:52.905858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-40c8ee02-75b1-40c6-95ba-5300b4baa811 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:52.906473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-40c8ee02-75b1-40c6-95ba-5300b4baa811 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:52.923115 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.934071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-40c8ee02-75b1-40c6-95ba-5300b4baa811 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Going to try to terminate instance {{(pid=117773) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:03:53.024742 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-40c8ee02-75b1-40c6-95ba-5300b4baa811 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 204 len: 0 microversion: 2.1 time: 0.131083 Aug 02 09:03:53.025598 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 408/813] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:03:52 2022] DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:53.034142 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d01aa01e-d244-441f-8cdd-c6ed8afb171e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:53.034837 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d01aa01e-d244-441f-8cdd-c6ed8afb171e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:53.041279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d01aa01e-d244-441f-8cdd-c6ed8afb171e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:53.041804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d01aa01e-d244-441f-8cdd-c6ed8afb171e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:53.042624 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d01aa01e-d244-441f-8cdd-c6ed8afb171e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:53.043130 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d01aa01e-d244-441f-8cdd-c6ed8afb171e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:53.176756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d01aa01e-d244-441f-8cdd-c6ed8afb171e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:53.184368 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d01aa01e-d244-441f-8cdd-c6ed8afb171e tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1671 microversion: 2.1 time: 0.154033 Aug 02 09:03:53.184940 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 406/814] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:53 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:53.305855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0156327b-b6b7-41aa-a861-8b3774138e26 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: .version_select at 0x7f13fa8e8160>, body: {"keypair": {"name": "tempest-keypair-1734427278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAsrc+5667+IH/i50sTxDqgnZQaTTFR7eWj2Bet3NwAdDQwAc6Rf5+U74Obw7Qm64tlxsl7+I3Tfu0wmOFSK27Yq+We4DDg4plZG+VDxb3fU5xwmkus7tiUFpl1ASCB6A=="}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:53.322513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-0156327b-b6b7-41aa-a861-8b3774138e26 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for project 3179955b76864553a96682674d01b781. Resources: {'key_pairs'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:03:53.326527 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-0156327b-b6b7-41aa-a861-8b3774138e26 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for user f01062e92f974dc890897d19359e7e63 and project 3179955b76864553a96682674d01b781. Resources: {'key_pairs'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:03:53.348978 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0156327b-b6b7-41aa-a861-8b3774138e26 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047412 Aug 02 09:03:53.349575 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 409/815] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 09:03:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:54.207327 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-885fd28d-61ae-460c-b119-4aedb97552ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:54.208023 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-885fd28d-61ae-460c-b119-4aedb97552ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:54.215001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-885fd28d-61ae-460c-b119-4aedb97552ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:54.215445 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-885fd28d-61ae-460c-b119-4aedb97552ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:54.216238 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-885fd28d-61ae-460c-b119-4aedb97552ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:54.216674 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-885fd28d-61ae-460c-b119-4aedb97552ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:54.351139 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-885fd28d-61ae-460c-b119-4aedb97552ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:54.358926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-885fd28d-61ae-460c-b119-4aedb97552ef tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1671 microversion: 2.1 time: 0.155954 Aug 02 09:03:54.359567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 407/816] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:54 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:54.593017 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-122456844", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99261d5d-9777-4359-9363-b7001791ac96"}], "security_groups": [{"name": "tempest-securitygroup--172424522"}], "key_name": "tempest-keypair-1734427278", "user_data": "}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:54.695932 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] validate_networks() for [('99261d5d-9777-4359-9363-b7001791ac96', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:03:55.097654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:03:55.098075 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:03:55.098550 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:03:55.098952 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:03:55.099356 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:03:55.108648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:55.109093 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:55.109921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:55.110355 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:55.127860 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for project 3179955b76864553a96682674d01b781. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:03:55.132276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Getting quotas for user f01062e92f974dc890897d19359e7e63 and project 3179955b76864553a96682674d01b781. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:03:55.143204 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:03:55.145617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:03:55.195910 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-56e464f8-3ec1-4256-a65b-43a8c6d59cc0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.607284 Aug 02 09:03:55.196580 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 410/817] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:03:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:03:55.207634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8f14a691-8293-4510-91fd-64d7709d4fb7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:55.209571 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8f14a691-8293-4510-91fd-64d7709d4fb7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:55.267687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8f14a691-8293-4510-91fd-64d7709d4fb7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:55.275145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8f14a691-8293-4510-91fd-64d7709d4fb7 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1241 microversion: 2.1 time: 0.071718 Aug 02 09:03:55.275721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 408/818] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:55 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:55.383495 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3f8bd7f6-ea2e-475d-ab2f-d2f8c0ad1046 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:55.384318 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3f8bd7f6-ea2e-475d-ab2f-d2f8c0ad1046 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:55.392738 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f8bd7f6-ea2e-475d-ab2f-d2f8c0ad1046 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:55.393363 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f8bd7f6-ea2e-475d-ab2f-d2f8c0ad1046 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:55.394493 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f8bd7f6-ea2e-475d-ab2f-d2f8c0ad1046 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:55.395084 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3f8bd7f6-ea2e-475d-ab2f-d2f8c0ad1046 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:55.909458 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3f8bd7f6-ea2e-475d-ab2f-d2f8c0ad1046 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:55.918100 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3f8bd7f6-ea2e-475d-ab2f-d2f8c0ad1046 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1671 microversion: 2.1 time: 0.540906 Aug 02 09:03:55.918672 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 411/819] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:55 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1671 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:03:56.294991 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-00f94141-c29c-4841-be3a-a3d78dbbddf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:56.295736 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-00f94141-c29c-4841-be3a-a3d78dbbddf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:56.304471 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-00f94141-c29c-4841-be3a-a3d78dbbddf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:56.305249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-00f94141-c29c-4841-be3a-a3d78dbbddf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:56.306245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-00f94141-c29c-4841-be3a-a3d78dbbddf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:56.306758 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-00f94141-c29c-4841-be3a-a3d78dbbddf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:56.389688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-00f94141-c29c-4841-be3a-a3d78dbbddf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:56.397781 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-00f94141-c29c-4841-be3a-a3d78dbbddf0 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1301 microversion: 2.1 time: 0.106543 Aug 02 09:03:56.398995 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 409/820] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:56 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:56.560841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-b14d3888-8848-49ea-84bc-474ac02b9acb req-5886e656-5784-4852-aa1a-0e17ed85b9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0294f72-846b-4b03-8c91-063f464f63ae", "name": "network-vif-deleted", "tag": "750cd21e-fcf4-4d25-91ed-6d7d8912cfe5"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:56.572068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-b14d3888-8848-49ea-84bc-474ac02b9acb req-5886e656-5784-4852-aa1a-0e17ed85b9d1 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:56.572616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-b14d3888-8848-49ea-84bc-474ac02b9acb req-5886e656-5784-4852-aa1a-0e17ed85b9d1 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:56.588631 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-b14d3888-8848-49ea-84bc-474ac02b9acb req-5886e656-5784-4852-aa1a-0e17ed85b9d1 service nova] Creating event network-vif-deleted:750cd21e-fcf4-4d25-91ed-6d7d8912cfe5 for instance b0294f72-846b-4b03-8c91-063f464f63ae on hv-cinder-78729 Aug 02 09:03:56.598249 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-b14d3888-8848-49ea-84bc-474ac02b9acb req-5886e656-5784-4852-aa1a-0e17ed85b9d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040761 Aug 02 09:03:56.600081 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 412/821] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:56.941225 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:56.943314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:56.950216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:56.950667 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:56.951449 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:56.952801 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:56.985096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:56.985537 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:56.985975 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lazy-loading 'fault' on Instance uuid b0294f72-846b-4b03-8c91-063f464f63ae {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:03:57.049723 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b15c4ba64ca4097a4cdb653fdb94d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f068d1fec9a4e55b60cd782cf4ecf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:57.058695 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6e904c4c-7be1-4560-a4f9-493663f99061 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 200 len: 1326 microversion: 2.1 time: 0.122972 Aug 02 09:03:57.061046 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 410/822] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:56 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 1326 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:57.423114 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-faf78906-274e-4c4b-b80f-f44f7f80cbf9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:57.423892 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-faf78906-274e-4c4b-b80f-f44f7f80cbf9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:57.431024 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-faf78906-274e-4c4b-b80f-f44f7f80cbf9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:57.432592 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-faf78906-274e-4c4b-b80f-f44f7f80cbf9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:57.433617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-faf78906-274e-4c4b-b80f-f44f7f80cbf9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:57.433947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-faf78906-274e-4c4b-b80f-f44f7f80cbf9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:57.605476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-faf78906-274e-4c4b-b80f-f44f7f80cbf9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:57.617686 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-faf78906-274e-4c4b-b80f-f44f7f80cbf9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1366 microversion: 2.1 time: 0.200232 Aug 02 09:03:57.628941 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 413/823] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:57 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:57.954451 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-31c63855-431b-4727-89cc-e2b04efd56c6 req-483b06b9-7c4d-44bf-834f-bbbc9f9b6cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7948f8-3bfd-415b-9302-7f2953f2cfa7", "tag": "670d9b53-f871-4d06-aa6b-4a8099de5556"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:57.966453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-31c63855-431b-4727-89cc-e2b04efd56c6 req-483b06b9-7c4d-44bf-834f-bbbc9f9b6cf4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:57.967537 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-31c63855-431b-4727-89cc-e2b04efd56c6 req-483b06b9-7c4d-44bf-834f-bbbc9f9b6cf4 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:57.979245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-31c63855-431b-4727-89cc-e2b04efd56c6 req-483b06b9-7c4d-44bf-834f-bbbc9f9b6cf4 service nova] Creating event network-changed:670d9b53-f871-4d06-aa6b-4a8099de5556 for instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 on hv-cinder-78729 Aug 02 09:03:57.985146 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-31c63855-431b-4727-89cc-e2b04efd56c6 req-483b06b9-7c4d-44bf-834f-bbbc9f9b6cf4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035124 Aug 02 09:03:57.985826 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 411/824] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:03:58.082053 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:58.082648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:58.091307 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:58.092022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:58.092861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:58.093243 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:58.106551 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] HTTP exception thrown: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Request method failure captured: Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae HTTP/1.1 Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYcek9YCzLwsmB6KPO36rL13cyDyidbzXGve9Ps-f00TBANRX-Hi_-rFnluXS2qvLuovLnNvy__4y0dHqzSKAopMuU8bbf6eSToIKdABew7yNStouoFdNgslNZG0LgKI8HdUYQQqTWLNpQRZt0cPOtzj2ZhQsd6gg_FoYGvyZPDPa0 Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:03:58.108237 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f068d1fec9a4e55b60cd782cf4ecf89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}] Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 2b15c4ba64ca4097a4cdb653fdb94d78 Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:03:58.109879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'b0294f72-846b-4b03-8c91-063f464f63ae'} Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:58.110818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:03:58.112399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:03:58.114033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Returning 404 to user: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:58.114033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6cbf90cb-66bd-4cbd-9556-867524e1b627 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 404 len: 111 microversion: 2.1 time: 0.031816 Aug 02 09:03:58.114033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 414/825] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:58 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:03:58.119524 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1c395557-643c-49c3-beb7-95e277953152 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '.version_select at 0x7f13fa90adc0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:58.142818 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1c395557-643c-49c3-beb7-95e277953152 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212585880" status: 202 len: 0 microversion: 2.1 time: 0.027854 Aug 02 09:03:58.143396 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 412/826] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 2 09:03:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212585880 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:03:58.646896 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7a56c7f2-5cf1-41b6-bf2d-e1835c1e1a10 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:58.647549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7a56c7f2-5cf1-41b6-bf2d-e1835c1e1a10 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:58.654763 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a56c7f2-5cf1-41b6-bf2d-e1835c1e1a10 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:58.655224 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a56c7f2-5cf1-41b6-bf2d-e1835c1e1a10 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:58.656058 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a56c7f2-5cf1-41b6-bf2d-e1835c1e1a10 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:58.656616 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a56c7f2-5cf1-41b6-bf2d-e1835c1e1a10 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:58.861716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7a56c7f2-5cf1-41b6-bf2d-e1835c1e1a10 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:03:58.869770 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7a56c7f2-5cf1-41b6-bf2d-e1835c1e1a10 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1366 microversion: 2.1 time: 0.226732 Aug 02 09:03:58.870352 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 415/827] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:58 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:59.890560 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-21c2f299-5b18-4b78-a33f-15be56f5cdd6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:59.891294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-21c2f299-5b18-4b78-a33f-15be56f5cdd6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:03:59.898609 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-21c2f299-5b18-4b78-a33f-15be56f5cdd6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:59.899058 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-21c2f299-5b18-4b78-a33f-15be56f5cdd6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:03:59.899821 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-21c2f299-5b18-4b78-a33f-15be56f5cdd6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:03:59.900289 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-21c2f299-5b18-4b78-a33f-15be56f5cdd6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:00.040830 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-21c2f299-5b18-4b78-a33f-15be56f5cdd6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:00.048355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-21c2f299-5b18-4b78-a33f-15be56f5cdd6 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1366 microversion: 2.1 time: 0.161690 Aug 02 09:04:00.048932 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 413/828] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:03:59 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:01.069061 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d3cf7bf7-1080-464a-9ce4-a1c295082d07 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:01.070288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d3cf7bf7-1080-464a-9ce4-a1c295082d07 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:01.078172 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3cf7bf7-1080-464a-9ce4-a1c295082d07 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:01.078635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3cf7bf7-1080-464a-9ce4-a1c295082d07 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:01.079419 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3cf7bf7-1080-464a-9ce4-a1c295082d07 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:01.079860 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3cf7bf7-1080-464a-9ce4-a1c295082d07 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:01.214559 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3cf7bf7-1080-464a-9ce4-a1c295082d07 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:01.221994 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d3cf7bf7-1080-464a-9ce4-a1c295082d07 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1366 microversion: 2.1 time: 0.156881 Aug 02 09:04:01.222963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 416/829] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:01 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:01.337249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:01.337947 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:01.346337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:01.346971 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:01.347743 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:01.348227 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:01.362461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] HTTP exception thrown: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Request method failure captured: Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae HTTP/1.1 Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYcek9YCzLwsmB6KPO36rL13cyDyidbzXGve9Ps-f00TBANRX-Hi_-rFnluXS2qvLuovLnNvy__4y0dHqzSKAopMuU8bbf6eSToIKdABew7yNStouoFdNgslNZG0LgKI8HdUYQQqTWLNpQRZt0cPOtzj2ZhQsd6gg_FoYGvyZPDPa0 Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:04:01.364137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f068d1fec9a4e55b60cd782cf4ecf89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}] Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 2b15c4ba64ca4097a4cdb653fdb94d78 Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.365679 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'b0294f72-846b-4b03-8c91-063f464f63ae'} Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:01.366699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.369001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.370450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Returning 404 to user: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:01.370450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2ad92589-1f8f-4d45-a912-d9808ea9df96 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 404 len: 111 microversion: 2.1 time: 0.034192 Aug 02 09:04:01.370450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 414/830] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:04:01 2022] DELETE /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:04:01.374614 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:01.375224 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: b0294f72-846b-4b03-8c91-063f464f63ae] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:01.381221 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:01.381667 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:01.382467 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:01.382900 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:01.396672 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] HTTP exception thrown: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Request method failure captured: Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae HTTP/1.1 Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYcek9YCzLwsmB6KPO36rL13cyDyidbzXGve9Ps-f00TBANRX-Hi_-rFnluXS2qvLuovLnNvy__4y0dHqzSKAopMuU8bbf6eSToIKdABew7yNStouoFdNgslNZG0LgKI8HdUYQQqTWLNpQRZt0cPOtzj2ZhQsd6gg_FoYGvyZPDPa0 Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:04:01.398175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f068d1fec9a4e55b60cd782cf4ecf89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}] Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 2b15c4ba64ca4097a4cdb653fdb94d78 Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.400649 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'b0294f72-846b-4b03-8c91-063f464f63ae'} Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:01.402018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. Aug 02 09:04:01.404290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:01.406274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Returning 404 to user: Instance b0294f72-846b-4b03-8c91-063f464f63ae could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:01.406274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c7f8edfb-3b06-463d-800c-1ed4293db86d tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae" status: 404 len: 111 microversion: 2.1 time: 0.028766 Aug 02 09:04:01.406274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 417/831] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:01 2022] GET /compute/v2.1/servers/b0294f72-846b-4b03-8c91-063f464f63ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:04:02.242958 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ed36ed6b-0297-4ace-a26f-cbe2fac4603f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:02.243560 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ed36ed6b-0297-4ace-a26f-cbe2fac4603f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:02.249481 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed36ed6b-0297-4ace-a26f-cbe2fac4603f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:02.249925 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed36ed6b-0297-4ace-a26f-cbe2fac4603f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:02.250682 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed36ed6b-0297-4ace-a26f-cbe2fac4603f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:02.251113 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ed36ed6b-0297-4ace-a26f-cbe2fac4603f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:02.385618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-ed36ed6b-0297-4ace-a26f-cbe2fac4603f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:02.393071 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ed36ed6b-0297-4ace-a26f-cbe2fac4603f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1366 microversion: 2.1 time: 0.153987 Aug 02 09:04:02.393633 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 415/832] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:02 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:02.538423 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:02.538915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:02.545381 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:02.545824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:02.546583 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:02.547015 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:02.560681 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] HTTP exception thrown: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Request method failure captured: Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: DELETE /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d HTTP/1.1 Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYcek9YCzLwsmB6KPO36rL13cyDyidbzXGve9Ps-f00TBANRX-Hi_-rFnluXS2qvLuovLnNvy__4y0dHqzSKAopMuU8bbf6eSToIKdABew7yNStouoFdNgslNZG0LgKI8HdUYQQqTWLNpQRZt0cPOtzj2ZhQsd6gg_FoYGvyZPDPa0 Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:04:02.562198 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f068d1fec9a4e55b60cd782cf4ecf89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}] Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: 2b15c4ba64ca4097a4cdb653fdb94d78 Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.563814 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'a92713a6-b49a-4dd4-b944-0d370dd4326d'} Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:02.564798 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.566375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.567915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Returning 404 to user: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:02.567915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f89525e4-de16-4a0f-b626-ae92f1463204 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 404 len: 111 microversion: 2.1 time: 0.028936 Aug 02 09:04:02.567915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 418/833] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:04:02 2022] DELETE /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:04:02.573862 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:02.574478 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] [instance: a92713a6-b49a-4dd4-b944-0d370dd4326d] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:02.580855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:02.581308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:02.582077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:02.582523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:02.595549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] HTTP exception thrown: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Request method failure captured: Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d HTTP/1.1 Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYcek9YCzLwsmB6KPO36rL13cyDyidbzXGve9Ps-f00TBANRX-Hi_-rFnluXS2qvLuovLnNvy__4y0dHqzSKAopMuU8bbf6eSToIKdABew7yNStouoFdNgslNZG0LgKI8HdUYQQqTWLNpQRZt0cPOtzj2ZhQsd6gg_FoYGvyZPDPa0 Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:04:02.597208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f068d1fec9a4e55b60cd782cf4ecf89", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f068d1fec9a4e55b60cd782cf4ecf89"}]}] Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 7f068d1fec9a4e55b60cd782cf4ecf89 Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1145108162 Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 2b15c4ba64ca4097a4cdb653fdb94d78 Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeTestJSON-1145108162-project Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.598580 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'a92713a6-b49a-4dd4-b944-0d370dd4326d'} Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:02.599442 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. Aug 02 09:04:02.600776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:02.601870 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] Returning 404 to user: Instance a92713a6-b49a-4dd4-b944-0d370dd4326d could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:02.601870 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-12c94712-df44-4e23-b6d0-d65dc22f0fd0 tempest-AttachVolumeTestJSON-1145108162 tempest-AttachVolumeTestJSON-1145108162-project] 10.222.0.17 "GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d" status: 404 len: 111 microversion: 2.1 time: 0.029266 Aug 02 09:04:02.601870 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 416/834] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:02 2022] GET /compute/v2.1/servers/a92713a6-b49a-4dd4-b944-0d370dd4326d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:04:03.413110 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7832bedb-b54a-4492-90d3-9368cc1c16d3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:03.414351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7832bedb-b54a-4492-90d3-9368cc1c16d3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:03.420473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7832bedb-b54a-4492-90d3-9368cc1c16d3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:03.420919 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7832bedb-b54a-4492-90d3-9368cc1c16d3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:03.421677 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7832bedb-b54a-4492-90d3-9368cc1c16d3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:03.422109 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7832bedb-b54a-4492-90d3-9368cc1c16d3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:03.641515 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7832bedb-b54a-4492-90d3-9368cc1c16d3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:03.657569 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7832bedb-b54a-4492-90d3-9368cc1c16d3 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1366 microversion: 2.1 time: 0.248334 Aug 02 09:04:03.668151 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 419/835] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:03 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:04.343265 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-ba2d8c28-96f9-4166-ba58-bcbdff81ac41 req-892b94b9-e110-4a19-9375-0d112a037fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7948f8-3bfd-415b-9302-7f2953f2cfa7", "name": "network-vif-plugged", "status": "completed", "tag": "670d9b53-f871-4d06-aa6b-4a8099de5556"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:04.354429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-ba2d8c28-96f9-4166-ba58-bcbdff81ac41 req-892b94b9-e110-4a19-9375-0d112a037fc0 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:04.355186 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-ba2d8c28-96f9-4166-ba58-bcbdff81ac41 req-892b94b9-e110-4a19-9375-0d112a037fc0 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:04.368105 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-ba2d8c28-96f9-4166-ba58-bcbdff81ac41 req-892b94b9-e110-4a19-9375-0d112a037fc0 service nova] Creating event network-vif-plugged:670d9b53-f871-4d06-aa6b-4a8099de5556 for instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 on hv-cinder-78729 Aug 02 09:04:04.373209 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-ba2d8c28-96f9-4166-ba58-bcbdff81ac41 req-892b94b9-e110-4a19-9375-0d112a037fc0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033897 Aug 02 09:04:04.373855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 417/836] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:04.683819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-434f1267-6b3e-4d76-b66f-7637afdab1a2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:04.684549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-434f1267-6b3e-4d76-b66f-7637afdab1a2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:04.693273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-434f1267-6b3e-4d76-b66f-7637afdab1a2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:04.693819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-434f1267-6b3e-4d76-b66f-7637afdab1a2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:04.695255 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-434f1267-6b3e-4d76-b66f-7637afdab1a2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:04.695761 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-434f1267-6b3e-4d76-b66f-7637afdab1a2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:04.890439 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-434f1267-6b3e-4d76-b66f-7637afdab1a2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:04.899997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-434f1267-6b3e-4d76-b66f-7637afdab1a2 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1366 microversion: 2.1 time: 0.222059 Aug 02 09:04:04.900601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 420/837] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:04 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:04:05.919323 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:05.925222 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e7b21006-69fd-4b8a-986a-ab88982aad0d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:05.926053 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e7b21006-69fd-4b8a-986a-ab88982aad0d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:05.934021 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e7b21006-69fd-4b8a-986a-ab88982aad0d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:05.934563 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e7b21006-69fd-4b8a-986a-ab88982aad0d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:05.935592 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e7b21006-69fd-4b8a-986a-ab88982aad0d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:05.936256 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e7b21006-69fd-4b8a-986a-ab88982aad0d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:06.147056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e7b21006-69fd-4b8a-986a-ab88982aad0d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:06.155186 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e7b21006-69fd-4b8a-986a-ab88982aad0d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1366 microversion: 2.1 time: 0.236800 Aug 02 09:04:06.156285 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 418/838] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:05 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:07.126277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:07.127016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=10 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:07.177624 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2ad10be4-c02e-45f2-8a88-9e528de09920 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:07.178151 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2ad10be4-c02e-45f2-8a88-9e528de09920 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:07.185208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ad10be4-c02e-45f2-8a88-9e528de09920 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:07.185868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ad10be4-c02e-45f2-8a88-9e528de09920 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:07.186641 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ad10be4-c02e-45f2-8a88-9e528de09920 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:07.187110 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2ad10be4-c02e-45f2-8a88-9e528de09920 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:07.238486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-2e34b4d4-5843-4975-a64c-a29b273c7b73 tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Action: 'create', calling method: .version_select at 0x7f13faa23dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1951620583", "metadata": {"Type": "work"}}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:07.318956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2ad10be4-c02e-45f2-8a88-9e528de09920 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:07.328691 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2ad10be4-c02e-45f2-8a88-9e528de09920 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1555 microversion: 2.1 time: 0.154742 Aug 02 09:04:07.329519 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 419/839] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:07 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:07.351029 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0c543ce9-cc4a-4f30-87e4-0f3595f06324 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:07.351509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0c543ce9-cc4a-4f30-87e4-0f3595f06324 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:07.357596 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0c543ce9-cc4a-4f30-87e4-0f3595f06324 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:07.358170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0c543ce9-cc4a-4f30-87e4-0f3595f06324 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:07.359129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0c543ce9-cc4a-4f30-87e4-0f3595f06324 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:07.359574 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0c543ce9-cc4a-4f30-87e4-0f3595f06324 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:07.442742 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0c543ce9-cc4a-4f30-87e4-0f3595f06324 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095989 Aug 02 09:04:07.443334 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 420/840] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 2 09:04:07 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:07.565916 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-2e34b4d4-5843-4975-a64c-a29b273c7b73 tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.443966 Aug 02 09:04:07.566535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 421/841] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 2 09:04:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 445 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 09:04:07.578596 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-89f68228-43c0-412d-b94f-cc1c7ef39f03 tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Calling method '.version_select at 0x7f13fa94e550>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:07.634382 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-89f68228-43c0-412d-b94f-cc1c7ef39f03 tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054" status: 200 len: 353 microversion: 2.1 time: 0.059541 Aug 02 09:04:07.635169 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 421/842] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 09:04:07 2022] GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:08.385712 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-6c62695a-bfa2-49b3-8b1b-0afa736c3b40 req-7ae6b32d-5a53-4e97-9228-14d019c81382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7948f8-3bfd-415b-9302-7f2953f2cfa7", "tag": "670d9b53-f871-4d06-aa6b-4a8099de5556"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:08.395775 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-6c62695a-bfa2-49b3-8b1b-0afa736c3b40 req-7ae6b32d-5a53-4e97-9228-14d019c81382 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:08.396250 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-6c62695a-bfa2-49b3-8b1b-0afa736c3b40 req-7ae6b32d-5a53-4e97-9228-14d019c81382 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:08.406583 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-6c62695a-bfa2-49b3-8b1b-0afa736c3b40 req-7ae6b32d-5a53-4e97-9228-14d019c81382 service nova] Creating event network-changed:670d9b53-f871-4d06-aa6b-4a8099de5556 for instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 on hv-cinder-78729 Aug 02 09:04:08.413506 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-6c62695a-bfa2-49b3-8b1b-0afa736c3b40 req-7ae6b32d-5a53-4e97-9228-14d019c81382 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032467 Aug 02 09:04:08.414109 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 422/843] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:04:08.649183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3ebc7c65-3850-4576-a940-254e29b24d4a tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Calling method '.version_select at 0x7f13fa8bf280>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:08.706276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3ebc7c65-3850-4576-a940-254e29b24d4a tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054" status: 200 len: 354 microversion: 2.1 time: 0.061441 Aug 02 09:04:08.706931 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 422/844] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 09:04:08 2022] GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:08.721286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8cecb394-0b4e-4034-a31b-612388ed3555 tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Calling method '.version_select at 0x7f13fa8e8ee0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:08.774553 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8cecb394-0b4e-4034-a31b-612388ed3555 tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054" status: 200 len: 354 microversion: 2.1 time: 0.057296 Aug 02 09:04:08.775587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 423/845] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 09:04:08 2022] GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:04:08.794326 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-562984af-0f09-454c-821d-fb5865f0e099 tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Calling method '.version_select at 0x7f13fa932040>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:08.881077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-562984af-0f09-454c-821d-fb5865f0e099 tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054" status: 202 len: 0 microversion: 2.1 time: 0.091714 Aug 02 09:04:08.881953 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 423/846] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 09:04:08 2022] DELETE /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:04:08.890578 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d9492e06-a554-430d-936e-7f2d7dcbcaaa tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Calling method '.version_select at 0x7f13fa8909d0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:08.950526 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d9492e06-a554-430d-936e-7f2d7dcbcaaa tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054" status: 200 len: 353 microversion: 2.1 time: 0.064545 Aug 02 09:04:08.951432 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 424/847] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 09:04:08 2022] GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:09.965311 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-91927382-10a7-4c61-8da7-dea393b7711c tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Calling method '.version_select at 0x7f13fa94e9d0>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:09.993183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-91927382-10a7-4c61-8da7-dea393b7711c tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] HTTP exception thrown: Volume 1ead5c85-9cef-481b-8186-70112858c054 could not be found. Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-91927382-10a7-4c61-8da7-dea393b7711c tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Request method failure captured: Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054 HTTP/1.1 Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OiHSwscxTO9BSL_eTzpij-NpQo_bnnEcRsVVjYkBil-xGnXsPkwCFHO-1AuvSQXJXZ1sKoRvhqlKK8OcYqAD01hzaQNBQB7txI5KjX0rdj6YrQbog7WlFGvGHpO3sIHX7o7-_VbTn-31bC5UxJG9BlVxojnHyBE-kp1RyMI1wqAqoM Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 7ea58a3594cd43bab55f7608e4353eee Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-VolumesGetTestJSON-1040186214 Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:04:09.995251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea58a3594cd43bab55f7608e4353eee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea58a3594cd43bab55f7608e4353eee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea58a3594cd43bab55f7608e4353eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea58a3594cd43bab55f7608e4353eee"}]}] Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-VolumesGetTestJSON-1040186214 Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 7ea58a3594cd43bab55f7608e4353eee Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-VolumesGetTestJSON-1040186214 Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-VolumesGetTestJSON-1040186214-project Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 2901b4e7ec274441ab951e7c87e2df2d Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-VolumesGetTestJSON-1040186214-project Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Volume 1ead5c85-9cef-481b-8186-70112858c054 could not be found. Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '1ead5c85-9cef-481b-8186-70112858c054'} Aug 02 09:04:09.996835 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ead5c85-9cef-481b-8186-70112858c054 could not be found. (HTTP 404) (Request-ID: req-98301057-2222-4cb5-a61a-847b8062456e) Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:09.997845 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:04:09.999391 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ead5c85-9cef-481b-8186-70112858c054 could not be found. Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:04:10.000783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ead5c85-9cef-481b-8186-70112858c054 could not be found. Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ead5c85-9cef-481b-8186-70112858c054 could not be found. Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-91927382-10a7-4c61-8da7-dea393b7711c tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] Returning 404 to user: Volume 1ead5c85-9cef-481b-8186-70112858c054 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-91927382-10a7-4c61-8da7-dea393b7711c tempest-VolumesGetTestJSON-1040186214 tempest-VolumesGetTestJSON-1040186214-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054" status: 404 len: 109 microversion: 2.1 time: 0.035692 Aug 02 09:04:10.002178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 424/848] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 2 09:04:09 2022] GET /compute/v2.1/os-volumes/1ead5c85-9cef-481b-8186-70112858c054 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:04:23.068953 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.070345 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.075169 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d4c1ae42-a00c-4fec-964b-555bb5447424 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:23.075773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d4c1ae42-a00c-4fec-964b-555bb5447424 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:23.079999 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.081615 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=80 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.091972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d4c1ae42-a00c-4fec-964b-555bb5447424 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:23.092494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d4c1ae42-a00c-4fec-964b-555bb5447424 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:23.104921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d4c1ae42-a00c-4fec-964b-555bb5447424 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:23.105385 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d4c1ae42-a00c-4fec-964b-555bb5447424 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:23.136100 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d4c1ae42-a00c-4fec-964b-555bb5447424 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Going to try to terminate instance {{(pid=117773) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:04:23.235557 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d4c1ae42-a00c-4fec-964b-555bb5447424 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 204 len: 0 microversion: 2.1 time: 0.167717 Aug 02 09:04:23.236329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 425/849] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:04:23 2022] DELETE /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:04:23.242112 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-310e1a30-efcb-42a4-a0f4-eb7737b0fabb req-1d7f7403-709d-4950-8868-5e7d5c30e610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3981c8ca-8909-4516-8813-e3a3cd71960b", "tag": "4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:23.245897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ab55df12-d7c4-43b5-802b-5f164f24391e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:23.246890 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ab55df12-d7c4-43b5-802b-5f164f24391e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:23.254919 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-310e1a30-efcb-42a4-a0f4-eb7737b0fabb req-1d7f7403-709d-4950-8868-5e7d5c30e610 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:23.255606 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-310e1a30-efcb-42a4-a0f4-eb7737b0fabb req-1d7f7403-709d-4950-8868-5e7d5c30e610 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:23.255765 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ab55df12-d7c4-43b5-802b-5f164f24391e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:23.256431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ab55df12-d7c4-43b5-802b-5f164f24391e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:23.257271 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ab55df12-d7c4-43b5-802b-5f164f24391e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:23.257918 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ab55df12-d7c4-43b5-802b-5f164f24391e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:23.271042 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-310e1a30-efcb-42a4-a0f4-eb7737b0fabb req-1d7f7403-709d-4950-8868-5e7d5c30e610 service nova] Creating event network-changed:4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55 for instance 3981c8ca-8909-4516-8813-e3a3cd71960b on hv-cinder-78729 Aug 02 09:04:23.277507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-310e1a30-efcb-42a4-a0f4-eb7737b0fabb req-1d7f7403-709d-4950-8868-5e7d5c30e610 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206656 Aug 02 09:04:23.278855 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 425/850] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:23.467297 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ab55df12-d7c4-43b5-802b-5f164f24391e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:23.475418 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ab55df12-d7c4-43b5-802b-5f164f24391e tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.234327 Aug 02 09:04:23.476331 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 426/851] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:23 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:04:24.499917 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-55bc7eb8-b012-4879-86b8-d97e6b7845cf tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:24.500817 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-55bc7eb8-b012-4879-86b8-d97e6b7845cf tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:24.507238 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-55bc7eb8-b012-4879-86b8-d97e6b7845cf tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:24.507767 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-55bc7eb8-b012-4879-86b8-d97e6b7845cf tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:24.508652 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-55bc7eb8-b012-4879-86b8-d97e6b7845cf tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:24.509091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-55bc7eb8-b012-4879-86b8-d97e6b7845cf tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:24.738718 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-55bc7eb8-b012-4879-86b8-d97e6b7845cf tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:24.753249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-55bc7eb8-b012-4879-86b8-d97e6b7845cf tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1567 microversion: 2.1 time: 0.258132 Aug 02 09:04:24.758707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 426/852] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:24 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:25.775580 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-dfb51bf2-5710-4645-8095-6591d3f289c7 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:25.776796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-dfb51bf2-5710-4645-8095-6591d3f289c7 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:25.783854 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dfb51bf2-5710-4645-8095-6591d3f289c7 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:25.784654 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dfb51bf2-5710-4645-8095-6591d3f289c7 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:25.785332 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dfb51bf2-5710-4645-8095-6591d3f289c7 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:25.785774 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dfb51bf2-5710-4645-8095-6591d3f289c7 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:25.874074 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-dfb51bf2-5710-4645-8095-6591d3f289c7 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2cc95918e4f457f955161df0dd0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e34c8b3cec84078bbb2121ae4a279de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:25.881970 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-dfb51bf2-5710-4645-8095-6591d3f289c7 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 200 len: 1381 microversion: 2.1 time: 0.110774 Aug 02 09:04:25.882549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 427/853] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:25 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 1381 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:25.943725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-3a663bf7-a536-4076-b40c-cbd00153e695 req-367a34da-e872-4c9f-aaee-de75d4106e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3981c8ca-8909-4516-8813-e3a3cd71960b", "name": "network-vif-deleted", "tag": "4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:25.953388 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-3a663bf7-a536-4076-b40c-cbd00153e695 req-367a34da-e872-4c9f-aaee-de75d4106e56 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:25.953910 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-3a663bf7-a536-4076-b40c-cbd00153e695 req-367a34da-e872-4c9f-aaee-de75d4106e56 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:25.965579 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-3a663bf7-a536-4076-b40c-cbd00153e695 req-367a34da-e872-4c9f-aaee-de75d4106e56 service nova] Creating event network-vif-deleted:4ae6b550-f9e3-4ffe-82d7-5f20c8fc3c55 for instance 3981c8ca-8909-4516-8813-e3a3cd71960b on hv-cinder-78729 Aug 02 09:04:25.970422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-3a663bf7-a536-4076-b40c-cbd00153e695 req-367a34da-e872-4c9f-aaee-de75d4106e56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182664 Aug 02 09:04:25.971280 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 427/854] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:04:26.904290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:26.905015 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] [instance: 3981c8ca-8909-4516-8813-e3a3cd71960b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:26.914918 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:26.915368 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:26.916498 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:26.916937 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:26.932499 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] HTTP exception thrown: Instance 3981c8ca-8909-4516-8813-e3a3cd71960b could not be found. Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Request method failure captured: Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b HTTP/1.1 Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6Oc9Xi36tMZPisqt5_srYfUV5gmJoIS8RRaQf3-xCOlbqX1ssJNeh_ysIcND5zQIhXDpkkRwZe-Eo_HDqTaPuVxUb5NoWg-NbDxvZdXIenz5HPH7yelCnLFFgZS7EagdRkZXfCmZuVtJuvr7KNceGr2vthyMX2QukEK6-1ZlLlJBxdM Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 8e34c8b3cec84078bbb2121ae4a279de Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-TestShelveInstance-818595643 Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:04:26.934134 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8e34c8b3cec84078bbb2121ae4a279de", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8e34c8b3cec84078bbb2121ae4a279de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8e34c8b3cec84078bbb2121ae4a279de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8e34c8b3cec84078bbb2121ae4a279de"}]}] Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-TestShelveInstance-818595643 Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 8e34c8b3cec84078bbb2121ae4a279de Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-TestShelveInstance-818595643 Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-TestShelveInstance-818595643-project Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: e2cc95918e4f457f955161df0dd0ebde Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-TestShelveInstance-818595643-project Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 3981c8ca-8909-4516-8813-e3a3cd71960b could not be found. Aug 02 09:04:26.935698 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '3981c8ca-8909-4516-8813-e3a3cd71960b'} Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3981c8ca-8909-4516-8813-e3a3cd71960b could not be found. Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:26.936618 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3981c8ca-8909-4516-8813-e3a3cd71960b could not be found. Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3981c8ca-8909-4516-8813-e3a3cd71960b could not be found. Aug 02 09:04:26.938203 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:26.939613 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Returning 404 to user: Instance 3981c8ca-8909-4516-8813-e3a3cd71960b could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:26.939613 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b67d47e7-4e5d-4e5e-bf2b-c5205f7ca94a tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b" status: 404 len: 111 microversion: 2.1 time: 0.035224 Aug 02 09:04:26.939613 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 428/855] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:04:26 2022] GET /compute/v2.1/servers/3981c8ca-8909-4516-8813-e3a3cd71960b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:04:27.102688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-366b2446-c697-41ea-8994-d2204f076594 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] Calling method '.version_select at 0x7f13fa91c820>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:27.123706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-366b2446-c697-41ea-8994-d2204f076594 tempest-TestShelveInstance-818595643 tempest-TestShelveInstance-818595643-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1953494769" status: 202 len: 0 microversion: 2.1 time: 0.025628 Aug 02 09:04:27.124572 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 428/856] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Aug 2 09:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1953494769 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:04:44.675970 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e79eb657-aa95-4af1-a0fc-a878b6eefaa6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:44.678206 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e79eb657-aa95-4af1-a0fc-a878b6eefaa6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:44.681415 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:44.682670 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:44.688065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e79eb657-aa95-4af1-a0fc-a878b6eefaa6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:44.688553 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e79eb657-aa95-4af1-a0fc-a878b6eefaa6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:44.689348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e79eb657-aa95-4af1-a0fc-a878b6eefaa6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:44.689772 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e79eb657-aa95-4af1-a0fc-a878b6eefaa6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:44.720709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e79eb657-aa95-4af1-a0fc-a878b6eefaa6 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048689 Aug 02 09:04:44.721259 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 429/857] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 2 09:04:44 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:44.786474 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ba0743c4-9e63-48d2-837d-dac4444bb23c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:44.787091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ba0743c4-9e63-48d2-837d-dac4444bb23c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:44.789325 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=10 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:44.789967 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:44.796692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ba0743c4-9e63-48d2-837d-dac4444bb23c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:44.797144 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ba0743c4-9e63-48d2-837d-dac4444bb23c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:44.797918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ba0743c4-9e63-48d2-837d-dac4444bb23c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:44.798354 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ba0743c4-9e63-48d2-837d-dac4444bb23c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:44.824156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ba0743c4-9e63-48d2-837d-dac4444bb23c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:04:44.909717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ba0743c4-9e63-48d2-837d-dac4444bb23c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 204 len: 0 microversion: 2.20 time: 0.126881 Aug 02 09:04:44.910302 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 429/858] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 2 09:04:44 2022] DELETE /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:04:44.919092 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:44.920075 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:44.926769 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:44.927224 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:44.928004 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:44.928471 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:45.121818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:45.130532 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:45.132058 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:45.133866 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7a0ead48-2b6a-4675-a7dd-251b3f9be8e8 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.218651 Aug 02 09:04:45.133866 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 430/859] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:04:44 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:04:46.159003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:46.159963 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:46.167956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:46.168682 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:46.169790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:46.170459 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:46.333162 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:46.341992 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:46.343492 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:46.344873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8eef16ac-d507-491e-949b-e1bbd808944b tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.191171 Aug 02 09:04:46.345435 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 430/860] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:04:46 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:04:47.375622 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:47.378031 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:47.397456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:47.398405 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:47.399444 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:47.400764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:47.770221 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:47.787510 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:47.792216 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:47.795473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c620a044-aeee-4464-8176-71a6e9c15520 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1722 microversion: 2.20 time: 0.426260 Aug 02 09:04:47.804620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 431/861] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:04:47 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:48.441020 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-f176c379-eaca-4281-8170-3cbc820317e8 req-394742ce-8e7c-4c01-93f7-c3764fb5e782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1276a55d-d8fd-439c-abd7-16eeb8c44304", "name": "network-vif-deleted", "tag": "e7195430-61af-498a-b128-9ae974ec3d07"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:48.460683 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-f176c379-eaca-4281-8170-3cbc820317e8 req-394742ce-8e7c-4c01-93f7-c3764fb5e782 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:48.461392 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-f176c379-eaca-4281-8170-3cbc820317e8 req-394742ce-8e7c-4c01-93f7-c3764fb5e782 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:48.483119 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-f176c379-eaca-4281-8170-3cbc820317e8 req-394742ce-8e7c-4c01-93f7-c3764fb5e782 service nova] Creating event network-vif-deleted:e7195430-61af-498a-b128-9ae974ec3d07 for instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 on hv-cinder-78729 Aug 02 09:04:48.488223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-f176c379-eaca-4281-8170-3cbc820317e8 req-394742ce-8e7c-4c01-93f7-c3764fb5e782 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052002 Aug 02 09:04:48.489734 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 431/862] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:48.832280 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:48.833451 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:48.846985 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:48.847748 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:48.848908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:48.849545 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:48.898446 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:48.899261 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:48.899984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lazy-loading 'fault' on Instance uuid 1276a55d-d8fd-439c-abd7-16eeb8c44304 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:04:48.973496 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:48.981813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:48.983582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e846d960fa87451db8ae291e22b3cb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1f802c78a4317a0af32afb533eb8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:04:48.984960 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-dda77690-9275-4802-af93-a176f6a86b06 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 200 len: 1370 microversion: 2.20 time: 0.158077 Aug 02 09:04:48.987842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 432/863] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:04:48 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:50.013206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:50.014233 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:50.021322 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:50.021774 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:50.022555 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:50.023001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:50.037776 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] HTTP exception thrown: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Request method failure captured: Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 HTTP/1.1 Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYTjUbpm6WqGV57WtQmMCq7myk5Pd-YjkSM6X_-HfnY7HVNQ-HsTIED1GaQq8hajNi9675OI2PHojOXCBFKjRzMigFbX0VKIcobl99NYaIgb6zEK0MYXjCl4lVqGHTdgtVFn0q0-AkH6ENODPRtNtM-ARwoZC3SCz0G69lOyp7GTh8 Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:04:50.041352 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1cb1f802c78a4317a0af32afb533eb8a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}] Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e846d960fa87451db8ae291e22b3cb7b Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:50.043185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '1276a55d-d8fd-439c-abd7-16eeb8c44304'} Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:50.044160 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:50.045746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:50.047049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Returning 404 to user: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:50.047049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ca9414b4-8b8f-425c-883c-a113e0afd983 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 404 len: 111 microversion: 2.20 time: 0.036057 Aug 02 09:04:50.047049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 432/864] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:04:50 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:04:50.055794 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ee8d98ca-71e7-4dac-92c8-4b78035db4e7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '.version_select at 0x7f13faa55310>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:50.083319 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ee8d98ca-71e7-4dac-92c8-4b78035db4e7 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-860377018" status: 204 len: 0 microversion: 2.20 time: 0.034748 Aug 02 09:04:50.084961 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 433/865] 10.222.0.17 () {60 vars in 1259 bytes} [Tue Aug 2 09:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-860377018 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:04:51.960651 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:51.961522 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:51.968791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:51.969465 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:51.970602 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:51.971521 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:51.986834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] HTTP exception thrown: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Request method failure captured: Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 HTTP/1.1 Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYTjUbpm6WqGV57WtQmMCq7myk5Pd-YjkSM6X_-HfnY7HVNQ-HsTIED1GaQq8hajNi9675OI2PHojOXCBFKjRzMigFbX0VKIcobl99NYaIgb6zEK0MYXjCl4lVqGHTdgtVFn0q0-AkH6ENODPRtNtM-ARwoZC3SCz0G69lOyp7GTh8 Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:04:51.988458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1cb1f802c78a4317a0af32afb533eb8a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}] Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e846d960fa87451db8ae291e22b3cb7b Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:51.990243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '1276a55d-d8fd-439c-abd7-16eeb8c44304'} Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:51.991208 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:51.992793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:51.994834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Returning 404 to user: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:51.995363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-45559321-daf3-4c73-a9e6-b48d096d8714 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 404 len: 111 microversion: 2.20 time: 0.038970 Aug 02 09:04:51.999739 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 433/866] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 2 09:04:51 2022] DELETE /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:04:52.004404 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:52.005026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: 1276a55d-d8fd-439c-abd7-16eeb8c44304] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:52.013729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:52.014178 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:52.014963 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:52.015924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:52.030304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] HTTP exception thrown: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Request method failure captured: Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 HTTP/1.1 Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYTjUbpm6WqGV57WtQmMCq7myk5Pd-YjkSM6X_-HfnY7HVNQ-HsTIED1GaQq8hajNi9675OI2PHojOXCBFKjRzMigFbX0VKIcobl99NYaIgb6zEK0MYXjCl4lVqGHTdgtVFn0q0-AkH6ENODPRtNtM-ARwoZC3SCz0G69lOyp7GTh8 Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:04:52.032197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1cb1f802c78a4317a0af32afb533eb8a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}] Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: e846d960fa87451db8ae291e22b3cb7b Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:52.033786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '1276a55d-d8fd-439c-abd7-16eeb8c44304'} Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:52.034679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. Aug 02 09:04:52.036080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:52.038462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Returning 404 to user: Instance 1276a55d-d8fd-439c-abd7-16eeb8c44304 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:52.039480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ccce7dcc-0bab-4675-a6ee-31b69c7fa312 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304" status: 404 len: 111 microversion: 2.20 time: 0.039349 Aug 02 09:04:52.040768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 434/867] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:04:51 2022] GET /compute/v2.1/servers/1276a55d-d8fd-439c-abd7-16eeb8c44304 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:04:53.229457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:53.230565 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:53.237299 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:53.237998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:53.239067 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:53.239531 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:53.266651 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] HTTP exception thrown: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Request method failure captured: Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 HTTP/1.1 Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OYTjUbpm6WqGV57WtQmMCq7myk5Pd-YjkSM6X_-HfnY7HVNQ-HsTIED1GaQq8hajNi9675OI2PHojOXCBFKjRzMigFbX0VKIcobl99NYaIgb6zEK0MYXjCl4lVqGHTdgtVFn0q0-AkH6ENODPRtNtM-ARwoZC3SCz0G69lOyp7GTh8 Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:04:53.268635 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1cb1f802c78a4317a0af32afb533eb8a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}] Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e846d960fa87451db8ae291e22b3cb7b Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.270059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'b1f9c72f-350b-428c-b020-d16159e0c991'} Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:53.270814 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.272178 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.276083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Returning 404 to user: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:53.277541 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e70d345b-0635-47c5-af39-7c2db6a679f5 tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 404 len: 111 microversion: 2.20 time: 0.052614 Aug 02 09:04:53.279450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 434/868] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 2 09:04:53 2022] DELETE /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:04:53.288343 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:53.289684 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] [instance: b1f9c72f-350b-428c-b020-d16159e0c991] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:04:53.301872 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:53.302581 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:53.304421 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:53.305274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:53.323734 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] HTTP exception thrown: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Request method failure captured: Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 HTTP/1.1 Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OYTjUbpm6WqGV57WtQmMCq7myk5Pd-YjkSM6X_-HfnY7HVNQ-HsTIED1GaQq8hajNi9675OI2PHojOXCBFKjRzMigFbX0VKIcobl99NYaIgb6zEK0MYXjCl4lVqGHTdgtVFn0q0-AkH6ENODPRtNtM-ARwoZC3SCz0G69lOyp7GTh8 Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:04:53.331516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1cb1f802c78a4317a0af32afb533eb8a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1cb1f802c78a4317a0af32afb533eb8a"}]}] Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 1cb1f802c78a4317a0af32afb533eb8a Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-71661012 Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: e846d960fa87451db8ae291e22b3cb7b Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeShelveTestJSON-71661012-project Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.333304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'b1f9c72f-350b-428c-b020-d16159e0c991'} Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:53.334179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. Aug 02 09:04:53.335445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:04:53.348169 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] Returning 404 to user: Instance b1f9c72f-350b-428c-b020-d16159e0c991 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:53.349375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-552c63d3-f08e-402d-ba44-5cafacbda72c tempest-AttachVolumeShelveTestJSON-71661012 tempest-AttachVolumeShelveTestJSON-71661012-project] 10.222.0.17 "GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991" status: 404 len: 111 microversion: 2.20 time: 0.066427 Aug 02 09:04:53.361205 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 435/869] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 2 09:04:53 2022] GET /compute/v2.1/servers/b1f9c72f-350b-428c-b020-d16159e0c991 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:04:55.435196 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6ed6109e-c5fe-4abd-8aa9-2d9a120c02db tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Action: 'create', calling method: .version_select at 0x7f13fa99b790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2022130069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9G3JrJOcgSnGN9SC+MlIc+GmqTWFG2PgwfjDptiT6dCWklJqZ3/9aOo80+6l4pcfM/HSxxIm7RAFBUfmvsrUjvBlNo+mPT2Sm6Oi1HN2O+NNgkyUh4Vb4urSv3f0erqA=="}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:55.451207 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-6ed6109e-c5fe-4abd-8aa9-2d9a120c02db tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Getting quotas for project 4b7960c66a61441faa18ef4ba42f5e5e. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:04:55.455457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-6ed6109e-c5fe-4abd-8aa9-2d9a120c02db tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Getting quotas for user e469194b140942bf929001c7e12a0933 and project 4b7960c66a61441faa18ef4ba42f5e5e. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:04:55.482896 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6ed6109e-c5fe-4abd-8aa9-2d9a120c02db tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.286800 Aug 02 09:04:55.484038 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 435/870] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 09:04:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:05:26.572532 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905271728", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2022130069", "security_groups": [{"name": "tempest-secgroup-smoke-1261723041"}], "block_device_mapping_v2": [{"uuid": "889d5074-83a7-467c-850f-74b206fbedd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e340dc33-11ff-4604-ba77-133c90e12728"}]}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:05:26.584001 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:26.584821 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=30 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:26.693131 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] validate_networks() for [('e340dc33-11ff-4604-ba77-133c90e12728', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:05:27.168410 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:05:27.168855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:05:27.169321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:05:27.169750 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:05:27.170155 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:05:27.179176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:27.179619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:27.180443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:27.180867 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:27.197657 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Getting quotas for project 4b7960c66a61441faa18ef4ba42f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:05:27.201565 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Getting quotas for user e469194b140942bf929001c7e12a0933 and project 4b7960c66a61441faa18ef4ba42f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:05:27.258647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:05:27.260739 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='889d5074-83a7-467c-850f-74b206fbedd3',volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:05:27.392110 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e390cf98-ba57-4d10-9344-f9691748b11a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.825485 Aug 02 09:05:27.392762 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 436/871] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:05:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:05:27.401007 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:27.401818 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=4 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:27.402846 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:27.408510 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-50790318-867e-40be-8e1a-ebe867d07a08 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:27.409121 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-50790318-867e-40be-8e1a-ebe867d07a08 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:27.470885 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-50790318-867e-40be-8e1a-ebe867d07a08 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:27.477712 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-50790318-867e-40be-8e1a-ebe867d07a08 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1095 microversion: 2.1 time: 0.078171 Aug 02 09:05:27.478459 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 436/872] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:27 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:28.498361 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b92c1f5e-f64a-4f90-a023-a1ab057bc0a1 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:28.498972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b92c1f5e-f64a-4f90-a023-a1ab057bc0a1 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:28.505088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b92c1f5e-f64a-4f90-a023-a1ab057bc0a1 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:28.505533 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b92c1f5e-f64a-4f90-a023-a1ab057bc0a1 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:28.506289 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b92c1f5e-f64a-4f90-a023-a1ab057bc0a1 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:28.506719 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b92c1f5e-f64a-4f90-a023-a1ab057bc0a1 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:28.575622 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b92c1f5e-f64a-4f90-a023-a1ab057bc0a1 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:28.583581 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b92c1f5e-f64a-4f90-a023-a1ab057bc0a1 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1193 microversion: 2.1 time: 0.089667 Aug 02 09:05:28.584161 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 437/873] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:28 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:29.158453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:05:29.158951 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 09:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:05:29.604662 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2a4a2dac-2d59-4bea-9e13-190b6e279cb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:29.605273 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2a4a2dac-2d59-4bea-9e13-190b6e279cb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:29.611854 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2a4a2dac-2d59-4bea-9e13-190b6e279cb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:29.612322 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2a4a2dac-2d59-4bea-9e13-190b6e279cb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:29.613088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2a4a2dac-2d59-4bea-9e13-190b6e279cb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:29.613521 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2a4a2dac-2d59-4bea-9e13-190b6e279cb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:29.676994 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2a4a2dac-2d59-4bea-9e13-190b6e279cb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:29.685085 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2a4a2dac-2d59-4bea-9e13-190b6e279cb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1201 microversion: 2.1 time: 0.084301 Aug 02 09:05:29.685643 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 437/874] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:29 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1201 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:30.706466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-71a1a275-ca25-4fa4-a592-781f62d03eb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:30.707081 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-71a1a275-ca25-4fa4-a592-781f62d03eb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:30.713673 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-71a1a275-ca25-4fa4-a592-781f62d03eb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:30.714124 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-71a1a275-ca25-4fa4-a592-781f62d03eb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:30.714893 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-71a1a275-ca25-4fa4-a592-781f62d03eb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:30.715334 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-71a1a275-ca25-4fa4-a592-781f62d03eb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:30.777145 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-71a1a275-ca25-4fa4-a592-781f62d03eb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:30.784625 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-71a1a275-ca25-4fa4-a592-781f62d03eb0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1211 microversion: 2.1 time: 0.082299 Aug 02 09:05:30.785189 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 438/875] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:30 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:31.806093 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fe1a0fb6-e206-4456-bf69-052db3b2c1a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:31.806707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fe1a0fb6-e206-4456-bf69-052db3b2c1a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:31.818536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fe1a0fb6-e206-4456-bf69-052db3b2c1a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:31.818536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fe1a0fb6-e206-4456-bf69-052db3b2c1a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:31.819669 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fe1a0fb6-e206-4456-bf69-052db3b2c1a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:31.820021 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fe1a0fb6-e206-4456-bf69-052db3b2c1a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:31.889574 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fe1a0fb6-e206-4456-bf69-052db3b2c1a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:31.897752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fe1a0fb6-e206-4456-bf69-052db3b2c1a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1211 microversion: 2.1 time: 0.095377 Aug 02 09:05:31.898893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 438/876] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:31 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:32.919688 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d248515b-cb7b-47cd-b07b-8c0013190616 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:32.920477 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d248515b-cb7b-47cd-b07b-8c0013190616 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:32.927499 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d248515b-cb7b-47cd-b07b-8c0013190616 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:32.927952 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d248515b-cb7b-47cd-b07b-8c0013190616 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:32.929121 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d248515b-cb7b-47cd-b07b-8c0013190616 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:32.930415 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d248515b-cb7b-47cd-b07b-8c0013190616 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:33.150281 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-aa1d38f1-c528-4e78-be18-cfcfcf9d6064 req-e6f2ef03-ecde-47e4-81cc-c1ce97cada28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8145a1-e135-4e3f-90c3-ce4959c7b4df", "tag": "5a473d55-3a7a-498a-b2b0-5a0bb520a97e"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:05:33.155301 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d248515b-cb7b-47cd-b07b-8c0013190616 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:33.160818 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-aa1d38f1-c528-4e78-be18-cfcfcf9d6064 req-e6f2ef03-ecde-47e4-81cc-c1ce97cada28 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:33.161361 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-aa1d38f1-c528-4e78-be18-cfcfcf9d6064 req-e6f2ef03-ecde-47e4-81cc-c1ce97cada28 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:33.165361 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d248515b-cb7b-47cd-b07b-8c0013190616 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.249859 Aug 02 09:05:33.166500 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 439/877] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:32 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:33.175703 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-aa1d38f1-c528-4e78-be18-cfcfcf9d6064 req-e6f2ef03-ecde-47e4-81cc-c1ce97cada28 service nova] Creating event network-changed:5a473d55-3a7a-498a-b2b0-5a0bb520a97e for instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df on hv-cinder-78729 Aug 02 09:05:33.180622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-aa1d38f1-c528-4e78-be18-cfcfcf9d6064 req-e6f2ef03-ecde-47e4-81cc-c1ce97cada28 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034440 Aug 02 09:05:33.181254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 439/878] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:05:34.186554 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-79a59f1d-b15e-40e7-a85e-9ad32d354601 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:34.187102 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-79a59f1d-b15e-40e7-a85e-9ad32d354601 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:34.193603 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-79a59f1d-b15e-40e7-a85e-9ad32d354601 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:34.194017 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-79a59f1d-b15e-40e7-a85e-9ad32d354601 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:34.194796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-79a59f1d-b15e-40e7-a85e-9ad32d354601 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:34.195236 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-79a59f1d-b15e-40e7-a85e-9ad32d354601 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:34.341147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-79a59f1d-b15e-40e7-a85e-9ad32d354601 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:34.348723 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-79a59f1d-b15e-40e7-a85e-9ad32d354601 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.166117 Aug 02 09:05:34.349282 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 440/879] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:34 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:35.371181 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-93de87c5-ba06-4f80-87ec-d9cb80f4b140 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:35.371911 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-93de87c5-ba06-4f80-87ec-d9cb80f4b140 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:35.378121 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-93de87c5-ba06-4f80-87ec-d9cb80f4b140 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:35.378573 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-93de87c5-ba06-4f80-87ec-d9cb80f4b140 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:35.379339 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-93de87c5-ba06-4f80-87ec-d9cb80f4b140 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:35.379777 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-93de87c5-ba06-4f80-87ec-d9cb80f4b140 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:35.513504 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-93de87c5-ba06-4f80-87ec-d9cb80f4b140 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:35.520957 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-93de87c5-ba06-4f80-87ec-d9cb80f4b140 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.154536 Aug 02 09:05:35.521520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 440/880] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:35 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:36.542590 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d86a05df-036d-44dc-be0b-4c25cef08a2a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:36.543226 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d86a05df-036d-44dc-be0b-4c25cef08a2a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:36.550010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d86a05df-036d-44dc-be0b-4c25cef08a2a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:36.550452 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d86a05df-036d-44dc-be0b-4c25cef08a2a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:36.551206 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d86a05df-036d-44dc-be0b-4c25cef08a2a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:36.551636 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d86a05df-036d-44dc-be0b-4c25cef08a2a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:36.680449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d86a05df-036d-44dc-be0b-4c25cef08a2a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:36.687994 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d86a05df-036d-44dc-be0b-4c25cef08a2a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.149881 Aug 02 09:05:36.688579 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 441/881] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:36 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:37.709096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3f59a158-0df8-4ad8-82ac-4f131e0b73d2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:37.709707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3f59a158-0df8-4ad8-82ac-4f131e0b73d2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:37.712247 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:37.717626 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f59a158-0df8-4ad8-82ac-4f131e0b73d2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:37.718251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f59a158-0df8-4ad8-82ac-4f131e0b73d2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:37.718844 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f59a158-0df8-4ad8-82ac-4f131e0b73d2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:37.719283 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f59a158-0df8-4ad8-82ac-4f131e0b73d2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:37.886176 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3f59a158-0df8-4ad8-82ac-4f131e0b73d2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:37.895004 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3f59a158-0df8-4ad8-82ac-4f131e0b73d2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.189724 Aug 02 09:05:37.905798 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 441/882] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:37 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:38.915047 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e2cbf83c-c316-4f8e-b493-dedfa5b341fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:38.915780 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e2cbf83c-c316-4f8e-b493-dedfa5b341fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:38.918014 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:38.918647 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=6 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:38.925013 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e2cbf83c-c316-4f8e-b493-dedfa5b341fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:38.925536 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e2cbf83c-c316-4f8e-b493-dedfa5b341fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:38.926325 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e2cbf83c-c316-4f8e-b493-dedfa5b341fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:38.926771 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e2cbf83c-c316-4f8e-b493-dedfa5b341fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:39.065735 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e2cbf83c-c316-4f8e-b493-dedfa5b341fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:39.073800 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e2cbf83c-c316-4f8e-b493-dedfa5b341fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.162879 Aug 02 09:05:39.074355 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 442/883] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:38 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:40.094211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f5fb1fbd-5974-48c1-85ea-af177e4fdce4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:40.094824 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f5fb1fbd-5974-48c1-85ea-af177e4fdce4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:40.101929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f5fb1fbd-5974-48c1-85ea-af177e4fdce4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:40.102377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f5fb1fbd-5974-48c1-85ea-af177e4fdce4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:40.103148 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f5fb1fbd-5974-48c1-85ea-af177e4fdce4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:40.103584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f5fb1fbd-5974-48c1-85ea-af177e4fdce4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:40.241188 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f5fb1fbd-5974-48c1-85ea-af177e4fdce4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:40.248576 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f5fb1fbd-5974-48c1-85ea-af177e4fdce4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.158181 Aug 02 09:05:40.249145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 442/884] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:40 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:41.270858 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4f32be41-a1e9-41db-bb8e-102bad821786 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:41.271403 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4f32be41-a1e9-41db-bb8e-102bad821786 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:41.278325 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4f32be41-a1e9-41db-bb8e-102bad821786 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:41.278772 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4f32be41-a1e9-41db-bb8e-102bad821786 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:41.279544 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4f32be41-a1e9-41db-bb8e-102bad821786 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:41.279981 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4f32be41-a1e9-41db-bb8e-102bad821786 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:41.409429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4f32be41-a1e9-41db-bb8e-102bad821786 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:41.417769 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4f32be41-a1e9-41db-bb8e-102bad821786 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.150877 Aug 02 09:05:41.418412 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 443/885] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:41 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:42.438956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7777bdc3-70e6-4924-8ef8-32365f4cf339 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:42.439620 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7777bdc3-70e6-4924-8ef8-32365f4cf339 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:42.446207 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7777bdc3-70e6-4924-8ef8-32365f4cf339 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:42.446650 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7777bdc3-70e6-4924-8ef8-32365f4cf339 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:42.447421 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7777bdc3-70e6-4924-8ef8-32365f4cf339 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:42.447856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7777bdc3-70e6-4924-8ef8-32365f4cf339 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:42.582518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7777bdc3-70e6-4924-8ef8-32365f4cf339 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:42.590945 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7777bdc3-70e6-4924-8ef8-32365f4cf339 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.156047 Aug 02 09:05:42.591532 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 443/886] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:42 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:05:43.611979 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-953d3d35-4140-4b87-a735-5df9486b2d22 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:43.613359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-953d3d35-4140-4b87-a735-5df9486b2d22 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:43.620460 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-953d3d35-4140-4b87-a735-5df9486b2d22 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:43.621002 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-953d3d35-4140-4b87-a735-5df9486b2d22 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:43.621855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-953d3d35-4140-4b87-a735-5df9486b2d22 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:43.622403 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-953d3d35-4140-4b87-a735-5df9486b2d22 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:43.862925 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-953d3d35-4140-4b87-a735-5df9486b2d22 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:43.870531 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-953d3d35-4140-4b87-a735-5df9486b2d22 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.262414 Aug 02 09:05:43.871419 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 444/887] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:43 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:44.768017 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-500faf73-cc95-4fe5-93a8-705fd9444e18 req-999a23e2-3413-4b52-8361-98f2cb523abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8145a1-e135-4e3f-90c3-ce4959c7b4df", "name": "network-vif-plugged", "status": "completed", "tag": "5a473d55-3a7a-498a-b2b0-5a0bb520a97e"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:05:44.777714 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-500faf73-cc95-4fe5-93a8-705fd9444e18 req-999a23e2-3413-4b52-8361-98f2cb523abd service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:44.778166 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-500faf73-cc95-4fe5-93a8-705fd9444e18 req-999a23e2-3413-4b52-8361-98f2cb523abd service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:44.790335 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-500faf73-cc95-4fe5-93a8-705fd9444e18 req-999a23e2-3413-4b52-8361-98f2cb523abd service nova] Creating event network-vif-plugged:5a473d55-3a7a-498a-b2b0-5a0bb520a97e for instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df on hv-cinder-78729 Aug 02 09:05:44.795445 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-500faf73-cc95-4fe5-93a8-705fd9444e18 req-999a23e2-3413-4b52-8361-98f2cb523abd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176239 Aug 02 09:05:44.796048 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 444/888] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:05:44.891946 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-98c3f635-c126-43a2-bb3a-82d9344abffc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:44.892646 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-98c3f635-c126-43a2-bb3a-82d9344abffc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:44.899207 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-98c3f635-c126-43a2-bb3a-82d9344abffc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:44.899664 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-98c3f635-c126-43a2-bb3a-82d9344abffc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:44.900468 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-98c3f635-c126-43a2-bb3a-82d9344abffc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:44.900913 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-98c3f635-c126-43a2-bb3a-82d9344abffc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:45.055225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-98c3f635-c126-43a2-bb3a-82d9344abffc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:45.062898 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-98c3f635-c126-43a2-bb3a-82d9344abffc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.174786 Aug 02 09:05:45.063908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 445/889] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:44 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:46.084775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-26ec95ef-11bd-40d1-9064-157bf99f99fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:46.085416 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-26ec95ef-11bd-40d1-9064-157bf99f99fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:46.091806 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26ec95ef-11bd-40d1-9064-157bf99f99fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:46.092281 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26ec95ef-11bd-40d1-9064-157bf99f99fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:46.093051 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26ec95ef-11bd-40d1-9064-157bf99f99fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:46.093488 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26ec95ef-11bd-40d1-9064-157bf99f99fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:46.222007 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-26ec95ef-11bd-40d1-9064-157bf99f99fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:46.229998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-26ec95ef-11bd-40d1-9064-157bf99f99fe tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1267 microversion: 2.1 time: 0.149942 Aug 02 09:05:46.230564 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 445/890] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:46 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:47.251046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-94f7ac1e-b73e-4289-8e3e-7ac9ea167c94 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:47.251670 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-94f7ac1e-b73e-4289-8e3e-7ac9ea167c94 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:47.258813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-94f7ac1e-b73e-4289-8e3e-7ac9ea167c94 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:47.259263 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-94f7ac1e-b73e-4289-8e3e-7ac9ea167c94 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:47.260023 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-94f7ac1e-b73e-4289-8e3e-7ac9ea167c94 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:47.260491 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-94f7ac1e-b73e-4289-8e3e-7ac9ea167c94 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:47.389642 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-94f7ac1e-b73e-4289-8e3e-7ac9ea167c94 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:47.397323 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-94f7ac1e-b73e-4289-8e3e-7ac9ea167c94 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1454 microversion: 2.1 time: 0.150406 Aug 02 09:05:47.397882 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 446/891] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:47 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:47.416727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3f34c368-0945-4365-b2a4-14c2c7bce208 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:47.417343 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3f34c368-0945-4365-b2a4-14c2c7bce208 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:47.423759 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f34c368-0945-4365-b2a4-14c2c7bce208 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:47.424454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f34c368-0945-4365-b2a4-14c2c7bce208 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:47.425225 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f34c368-0945-4365-b2a4-14c2c7bce208 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:47.425671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f34c368-0945-4365-b2a4-14c2c7bce208 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:47.571388 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3f34c368-0945-4365-b2a4-14c2c7bce208 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:05:47.579091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3f34c368-0945-4365-b2a4-14c2c7bce208 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1454 microversion: 2.1 time: 0.166136 Aug 02 09:05:47.579663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 446/892] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:05:47 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:48.546636 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-835eb615-6eab-4dbc-bb73-88fd21c72c68 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:48.547173 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-835eb615-6eab-4dbc-bb73-88fd21c72c68 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:48.554376 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-835eb615-6eab-4dbc-bb73-88fd21c72c68 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:48.555049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-835eb615-6eab-4dbc-bb73-88fd21c72c68 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:48.555841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-835eb615-6eab-4dbc-bb73-88fd21c72c68 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:48.556317 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-835eb615-6eab-4dbc-bb73-88fd21c72c68 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:48.579622 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-835eb615-6eab-4dbc-bb73-88fd21c72c68 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/ips" status: 200 len: 148 microversion: 2.1 time: 0.036823 Aug 02 09:05:48.580219 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 447/893] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 2 09:05:48 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:05:49.645579 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-1976144b-192a-48be-8052-05b2954230a1 req-a4c92c98-b7f1-4cfb-b5b6-265993d7005c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8145a1-e135-4e3f-90c3-ce4959c7b4df", "tag": "5a473d55-3a7a-498a-b2b0-5a0bb520a97e"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:05:49.664724 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1976144b-192a-48be-8052-05b2954230a1 req-a4c92c98-b7f1-4cfb-b5b6-265993d7005c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:49.665286 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1976144b-192a-48be-8052-05b2954230a1 req-a4c92c98-b7f1-4cfb-b5b6-265993d7005c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:49.677083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-1976144b-192a-48be-8052-05b2954230a1 req-a4c92c98-b7f1-4cfb-b5b6-265993d7005c service nova] Creating event network-changed:5a473d55-3a7a-498a-b2b0-5a0bb520a97e for instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df on hv-cinder-78729 Aug 02 09:05:49.683463 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-1976144b-192a-48be-8052-05b2954230a1 req-a4c92c98-b7f1-4cfb-b5b6-265993d7005c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041484 Aug 02 09:05:49.684587 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 447/894] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:05:50.031962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a4b60e4a-acd1-4faf-962f-569444f02e00 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "173b3675-8ece-4d1d-8481-570f1741be0e"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:05:50.036569 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a4b60e4a-acd1-4faf-962f-569444f02e00 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:05:50.047357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4b60e4a-acd1-4faf-962f-569444f02e00 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:50.048862 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4b60e4a-acd1-4faf-962f-569444f02e00 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:50.049660 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4b60e4a-acd1-4faf-962f-569444f02e00 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:50.050779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a4b60e4a-acd1-4faf-962f-569444f02e00 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:50.412426 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a4b60e4a-acd1-4faf-962f-569444f02e00 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "POST /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379378 Aug 02 09:05:50.420318 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 448/895] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 09:05:50 2022] POST /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:02.268441 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=26 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:02.269190 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=54 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:02.274919 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-45df46b0-5419-4ee7-a312-f9d25262ed2d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:02.275490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-45df46b0-5419-4ee7-a312-f9d25262ed2d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:02.282426 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-45df46b0-5419-4ee7-a312-f9d25262ed2d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:02.282877 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-45df46b0-5419-4ee7-a312-f9d25262ed2d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:02.283640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-45df46b0-5419-4ee7-a312-f9d25262ed2d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:02.284076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-45df46b0-5419-4ee7-a312-f9d25262ed2d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:02.366584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.objects.instance [None req-45df46b0-5419-4ee7-a312-f9d25262ed2d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lazy-loading 'services' on Instance uuid 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 {{(pid=117772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:06:02.437587 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-45df46b0-5419-4ee7-a312-f9d25262ed2d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments/173b3675-8ece-4d1d-8481-570f1741be0e" status: 202 len: 0 microversion: 2.1 time: 0.170443 Aug 02 09:06:02.438173 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 448/896] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 09:06:02 2022] DELETE /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments/173b3675-8ece-4d1d-8481-570f1741be0e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:06:02.448042 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-82e346ff-d88e-422f-a602-c4221ba27343 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:02.450870 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-82e346ff-d88e-422f-a602-c4221ba27343 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:02.453957 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:02.454795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:02.464909 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-82e346ff-d88e-422f-a602-c4221ba27343 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:02.465358 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-82e346ff-d88e-422f-a602-c4221ba27343 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:02.466154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-82e346ff-d88e-422f-a602-c4221ba27343 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:02.466601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-82e346ff-d88e-422f-a602-c4221ba27343 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:02.503221 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-82e346ff-d88e-422f-a602-c4221ba27343 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060378 Aug 02 09:06:02.503795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 449/897] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:06:02 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:03.516389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ac0fc6ef-8a8f-4601-8387-84b80c5fdb0a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:03.518602 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ac0fc6ef-8a8f-4601-8387-84b80c5fdb0a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:03.525673 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ac0fc6ef-8a8f-4601-8387-84b80c5fdb0a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:03.526127 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ac0fc6ef-8a8f-4601-8387-84b80c5fdb0a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:03.526923 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ac0fc6ef-8a8f-4601-8387-84b80c5fdb0a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:03.527363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ac0fc6ef-8a8f-4601-8387-84b80c5fdb0a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:03.555618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ac0fc6ef-8a8f-4601-8387-84b80c5fdb0a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Aug 02 09:06:03.556195 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 449/898] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:06:03 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:04.566823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-eb710863-3eee-47ae-8523-a9f114d53f21 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:04.569022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-eb710863-3eee-47ae-8523-a9f114d53f21 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:04.575457 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb710863-3eee-47ae-8523-a9f114d53f21 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:04.575905 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb710863-3eee-47ae-8523-a9f114d53f21 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:04.576962 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb710863-3eee-47ae-8523-a9f114d53f21 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:04.577398 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-eb710863-3eee-47ae-8523-a9f114d53f21 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:04.606496 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-eb710863-3eee-47ae-8523-a9f114d53f21 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Aug 02 09:06:04.607041 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 450/899] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:06:04 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:05.617669 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f9b9c9b2-7d2f-4627-8e87-bcb7e5dddb58 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:05.619777 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f9b9c9b2-7d2f-4627-8e87-bcb7e5dddb58 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:05.626131 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f9b9c9b2-7d2f-4627-8e87-bcb7e5dddb58 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:05.626575 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f9b9c9b2-7d2f-4627-8e87-bcb7e5dddb58 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:05.627331 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f9b9c9b2-7d2f-4627-8e87-bcb7e5dddb58 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:05.627761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f9b9c9b2-7d2f-4627-8e87-bcb7e5dddb58 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:05.657121 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f9b9c9b2-7d2f-4627-8e87-bcb7e5dddb58 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Aug 02 09:06:05.657702 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 450/900] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:06:05 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:06.677180 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-48467dbb-22c2-4ee3-9ad5-d6d9c490ce5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:06.679516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-48467dbb-22c2-4ee3-9ad5-d6d9c490ce5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:06.688973 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48467dbb-22c2-4ee3-9ad5-d6d9c490ce5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:06.689746 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48467dbb-22c2-4ee3-9ad5-d6d9c490ce5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:06.690535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48467dbb-22c2-4ee3-9ad5-d6d9c490ce5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:06.690968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-48467dbb-22c2-4ee3-9ad5-d6d9c490ce5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:06.725742 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-48467dbb-22c2-4ee3-9ad5-d6d9c490ce5d tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059012 Aug 02 09:06:06.726281 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 451/901] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:06:06 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:06:06.793937 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-556532ca-43c0-4133-bd3f-ef1d0e4d957e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:06.794499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-556532ca-43c0-4133-bd3f-ef1d0e4d957e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:06.808437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-556532ca-43c0-4133-bd3f-ef1d0e4d957e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:06.808437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-556532ca-43c0-4133-bd3f-ef1d0e4d957e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:06.808437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-556532ca-43c0-4133-bd3f-ef1d0e4d957e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:06.808437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-556532ca-43c0-4133-bd3f-ef1d0e4d957e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:06.829311 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-556532ca-43c0-4133-bd3f-ef1d0e4d957e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:06:06.922584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-556532ca-43c0-4133-bd3f-ef1d0e4d957e tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 204 len: 0 microversion: 2.1 time: 0.132909 Aug 02 09:06:06.923456 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 451/902] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:06:06 2022] DELETE /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:06:06.931436 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-41ed80dd-1c48-4613-92a4-02a890057ffa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:06.932056 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-41ed80dd-1c48-4613-92a4-02a890057ffa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:06.938193 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-41ed80dd-1c48-4613-92a4-02a890057ffa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:06.938639 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-41ed80dd-1c48-4613-92a4-02a890057ffa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:06.939443 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-41ed80dd-1c48-4613-92a4-02a890057ffa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:06.939876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-41ed80dd-1c48-4613-92a4-02a890057ffa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:07.078192 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-41ed80dd-1c48-4613-92a4-02a890057ffa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:07.086272 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-41ed80dd-1c48-4613-92a4-02a890057ffa tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1679 microversion: 2.1 time: 0.158726 Aug 02 09:06:07.087311 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 452/903] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:06 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:08.300184 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-47657e38-8a54-438c-8c41-71b3ceb6d93a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:08.300921 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-47657e38-8a54-438c-8c41-71b3ceb6d93a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:08.307065 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-47657e38-8a54-438c-8c41-71b3ceb6d93a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:08.307506 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-47657e38-8a54-438c-8c41-71b3ceb6d93a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:08.308329 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-47657e38-8a54-438c-8c41-71b3ceb6d93a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:08.308744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-47657e38-8a54-438c-8c41-71b3ceb6d93a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:08.440010 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-47657e38-8a54-438c-8c41-71b3ceb6d93a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:08.447475 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-47657e38-8a54-438c-8c41-71b3ceb6d93a tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1679 microversion: 2.1 time: 0.343185 Aug 02 09:06:08.448465 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 452/904] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:08 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1679 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:09.473570 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e73cb674-de30-40db-8b5e-8ebcc131bef4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:09.474310 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e73cb674-de30-40db-8b5e-8ebcc131bef4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:09.481686 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e73cb674-de30-40db-8b5e-8ebcc131bef4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:09.482143 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e73cb674-de30-40db-8b5e-8ebcc131bef4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:09.482912 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e73cb674-de30-40db-8b5e-8ebcc131bef4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:09.483355 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e73cb674-de30-40db-8b5e-8ebcc131bef4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:09.614116 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e73cb674-de30-40db-8b5e-8ebcc131bef4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:09.622214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e73cb674-de30-40db-8b5e-8ebcc131bef4 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1679 microversion: 2.1 time: 0.152817 Aug 02 09:06:09.622770 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 453/905] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:09 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:10.465003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-b2755ecb-9fb8-4c59-aa98-cd3e8f74ece4 req-8302c58f-250a-45a2-a767-5e1d67ee859c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7948f8-3bfd-415b-9302-7f2953f2cfa7", "name": "network-vif-deleted", "tag": "670d9b53-f871-4d06-aa6b-4a8099de5556"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:10.477369 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b2755ecb-9fb8-4c59-aa98-cd3e8f74ece4 req-8302c58f-250a-45a2-a767-5e1d67ee859c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:10.477875 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b2755ecb-9fb8-4c59-aa98-cd3e8f74ece4 req-8302c58f-250a-45a2-a767-5e1d67ee859c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:10.489958 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-b2755ecb-9fb8-4c59-aa98-cd3e8f74ece4 req-8302c58f-250a-45a2-a767-5e1d67ee859c service nova] Creating event network-vif-deleted:670d9b53-f871-4d06-aa6b-4a8099de5556 for instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 on hv-cinder-78729 Aug 02 09:06:10.494743 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-b2755ecb-9fb8-4c59-aa98-cd3e8f74ece4 req-8302c58f-250a-45a2-a767-5e1d67ee859c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 Aug 02 09:06:10.495343 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 453/906] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:10.644157 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:10.645635 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:10.662321 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:10.662801 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:10.663709 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:10.664802 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:10.723906 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:10.724739 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:10.725163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lazy-loading 'fault' on Instance uuid 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:06:10.774414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01062e92f974dc890897d19359e7e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3179955b76864553a96682674d01b781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:10.781948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4e981aee-9aab-4a24-9c9a-47fababfcf56 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 200 len: 1331 microversion: 2.1 time: 0.141856 Aug 02 09:06:10.782815 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 454/907] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:10 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:11.806826 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:11.807706 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:11.814725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:11.815177 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:11.815955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:11.816422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:11.832710 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 HTTP/1.1 Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:06:11.834342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:11.837073 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '3b7948f8-3bfd-415b-9302-7f2953f2cfa7'} Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:11.838090 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:11.839692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:11.841330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:11.841330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-072296e9-b9bc-4757-afc2-fe4a43bc36b5 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 404 len: 111 microversion: 2.1 time: 0.033617 Aug 02 09:06:11.841330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 454/908] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:11 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:11.846551 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ac4e6df3-8842-466a-bfc9-93f5f08ed692 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '.version_select at 0x7f13fa921af0>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:11.866400 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ac4e6df3-8842-466a-bfc9-93f5f08ed692 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734427278" status: 202 len: 0 microversion: 2.1 time: 0.024087 Aug 02 09:06:11.866976 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 455/909] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 2 09:06:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734427278 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:06:13.643800 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:13.644360 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:13.651086 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:13.651537 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:13.652345 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:13.652805 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:13.666156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 HTTP/1.1 Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:06:13.667689 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.669351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '3b7948f8-3bfd-415b-9302-7f2953f2cfa7'} Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:13.670309 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.671890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.673729 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:13.673729 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f5cac64c-2470-444c-9bb3-84f8b9f22a25 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 404 len: 111 microversion: 2.1 time: 0.029140 Aug 02 09:06:13.673729 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 455/910] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:06:13 2022] DELETE /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:13.680680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:13.681310 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 3b7948f8-3bfd-415b-9302-7f2953f2cfa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:13.688061 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:13.688538 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:13.689308 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:13.689755 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:13.703832 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 HTTP/1.1 Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:06:13.705594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.707220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '3b7948f8-3bfd-415b-9302-7f2953f2cfa7'} Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:13.708191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. Aug 02 09:06:13.709703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:13.711573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 3b7948f8-3bfd-415b-9302-7f2953f2cfa7 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:13.711573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4002bcd6-00a3-41b7-992d-d2e276808106 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7" status: 404 len: 111 microversion: 2.1 time: 0.031974 Aug 02 09:06:13.711573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 456/911] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:13 2022] GET /compute/v2.1/servers/3b7948f8-3bfd-415b-9302-7f2953f2cfa7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:14.859405 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:14.859922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:14.866454 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:14.868185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:14.869042 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:14.869484 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:14.883068 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 HTTP/1.1 Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:06:14.884645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.890036 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '4168c7d4-9466-4939-8905-6e4eb6efa7c4'} Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:14.890938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.892437 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.893859 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:14.893859 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-20472b41-cfe4-4fc8-a5c2-333c1f44f531 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 404 len: 111 microversion: 2.1 time: 0.030815 Aug 02 09:06:14.893859 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 456/912] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:06:14 2022] DELETE /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:14.894631 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:14.895256 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 4168c7d4-9466-4939-8905-6e4eb6efa7c4] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:14.902127 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:14.902582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:14.903377 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:14.903818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:14.918592 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 HTTP/1.1 Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:06:14.920277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.921656 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '4168c7d4-9466-4939-8905-6e4eb6efa7c4'} Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:14.922414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. Aug 02 09:06:14.923897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.925608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 4168c7d4-9466-4939-8905-6e4eb6efa7c4 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:14.925608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-19687871-a2f4-4cf3-b955-e772b045b5c9 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4" status: 404 len: 111 microversion: 2.1 time: 0.031240 Aug 02 09:06:14.925608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 457/913] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:14 2022] GET /compute/v2.1/servers/4168c7d4-9466-4939-8905-6e4eb6efa7c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:06:14.931219 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:14.931712 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:14.937939 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:14.938387 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:14.939164 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:14.939603 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:14.953083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 HTTP/1.1 Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:06:14.954616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.956314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '88d22468-69c0-45b8-8ee0-0bc6247befa7'} Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:14.957301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.958793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.960699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:14.960699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-20b15c39-a5d9-4b40-9ba8-fabc5aea2490 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 404 len: 111 microversion: 2.1 time: 0.029421 Aug 02 09:06:14.960699 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 457/914] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:06:14 2022] DELETE /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:14.965770 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:14.966411 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 88d22468-69c0-45b8-8ee0-0bc6247befa7] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:14.974055 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:14.974644 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:14.975431 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:14.975877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:14.989920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 HTTP/1.1 Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:06:14.991462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.993154 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '88d22468-69c0-45b8-8ee0-0bc6247befa7'} Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:14.994026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. Aug 02 09:06:14.995288 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:14.996519 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 88d22468-69c0-45b8-8ee0-0bc6247befa7 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:14.996519 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a343eb07-6539-45bd-8689-f72ce1f77b8f tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7" status: 404 len: 111 microversion: 2.1 time: 0.032369 Aug 02 09:06:14.996519 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 458/915] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:14 2022] GET /compute/v2.1/servers/88d22468-69c0-45b8-8ee0-0bc6247befa7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:06:16.145254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:16.147344 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:16.153171 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:16.153620 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:16.154398 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:16.154837 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:16.169752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 HTTP/1.1 Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:06:16.171507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.173070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '8f712963-5f32-4332-b6e9-30269a5dccd1'} Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:16.176852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.178129 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.179408 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:16.179408 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3cfab526-67b9-4517-9701-4fcee26cfdee tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 404 len: 111 microversion: 2.1 time: 0.031998 Aug 02 09:06:16.179408 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 458/916] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:06:16 2022] DELETE /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:16.182572 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:16.183348 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] [instance: 8f712963-5f32-4332-b6e9-30269a5dccd1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:16.191197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:16.191947 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:16.192906 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:16.193424 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:16.210907 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] HTTP exception thrown: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Request method failure captured: Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 HTTP/1.1 Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6OZ25-yE0zZOhPvoR6_AMQA2a0kzNUDgF_QW0BfdfUCa72v0bRQYOzYZOZh9dUXgTpTcKXkY1Qb7fNV3_4KYzUeQdcpQwGor4HDX5DgpAePQpVSamSPdlKCEhHsQUBichlFm7ucDjICbn4Hez8uNKQW_87pOuA3sL10RTKtYzDa0M30 Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:06:16.212868 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3179955b76864553a96682674d01b781", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3179955b76864553a96682674d01b781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3179955b76864553a96682674d01b781"}]}] Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 3179955b76864553a96682674d01b781 Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671947935 Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: f01062e92f974dc890897d19359e7e63 Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-AttachVolumeNegativeTest-671947935-project Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.214582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '8f712963-5f32-4332-b6e9-30269a5dccd1'} Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:16.215573 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. Aug 02 09:06:16.217118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.218489 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] Returning 404 to user: Instance 8f712963-5f32-4332-b6e9-30269a5dccd1 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:16.218489 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c80d1f0f-232a-4cd6-b1ac-222c20065d12 tempest-AttachVolumeNegativeTest-671947935 tempest-AttachVolumeNegativeTest-671947935-project] 10.222.0.17 "GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1" status: 404 len: 111 microversion: 2.1 time: 0.037358 Aug 02 09:06:16.218489 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 459/917] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:16 2022] GET /compute/v2.1/servers/8f712963-5f32-4332-b6e9-30269a5dccd1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:32.987039 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-56fb2153-caaf-4905-9db5-36c11bee086c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Action: 'create', calling method: .version_select at 0x7f13fabef940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-656764179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjlYVzGrkIrBNZ0bTf8Ol4ePI8xijhci/VmE/sdwb8MUogSw9SYf3ClpxgKxdivQsC+XZcdXdBAQIBTlfOYHfn5blxMuGb71ylrVhchpzkhDbbtD6vRdq9urg/IElBivw=="}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:32.993629 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:32.994274 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:33.009141 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-56fb2153-caaf-4905-9db5-36c11bee086c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Getting quotas for project 4e302e615c17471fa0c5638c2bc08b8c. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:33.012917 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-56fb2153-caaf-4905-9db5-36c11bee086c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Getting quotas for user 3639081f2d814af4bd963399a7a63312 and project 4e302e615c17471fa0c5638c2bc08b8c. Resources: {'key_pairs'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:33.033704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-56fb2153-caaf-4905-9db5-36c11bee086c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050414 Aug 02 09:06:33.034284 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 459/918] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 2 09:06:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:33.083462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-52207089", "imageRef": "a652af39-f826-47f0-b4ce-3e47f56f1334", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-656764179", "networks": [{"uuid": "7675ce13-ae3c-4566-9298-d09e499f0936"}]}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:33.094372 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:33.095023 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=46 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:33.139271 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] validate_networks() for [('7675ce13-ae3c-4566-9298-d09e499f0936', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:06:33.517985 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:06:33.518414 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:06:33.518927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:06:33.519373 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:06:33.519810 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:06:33.530144 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:33.530594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:33.531391 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:33.531830 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:33.548787 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Getting quotas for project 4e302e615c17471fa0c5638c2bc08b8c. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:33.552732 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Getting quotas for user 3639081f2d814af4bd963399a7a63312 and project 4e302e615c17471fa0c5638c2bc08b8c. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:33.564250 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:06:33.566438 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a652af39-f826-47f0-b4ce-3e47f56f1334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:06:33.611749 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ed553d85-d35a-470e-a737-41025e92998a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532088 Aug 02 09:06:33.612476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 460/919] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:06:33.623943 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-dfa3b544-36b3-4fc0-94fc-d2eb458434a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:33.624562 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-dfa3b544-36b3-4fc0-94fc-d2eb458434a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:33.678128 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dfa3b544-36b3-4fc0-94fc-d2eb458434a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:33.687076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-dfa3b544-36b3-4fc0-94fc-d2eb458434a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1256 microversion: 2.1 time: 0.067204 Aug 02 09:06:33.687721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 460/920] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:33 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:34.708968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b40ada4e-2a87-4add-b69e-e15e0a99c924 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:34.709546 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b40ada4e-2a87-4add-b69e-e15e0a99c924 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:34.716327 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b40ada4e-2a87-4add-b69e-e15e0a99c924 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:34.716727 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b40ada4e-2a87-4add-b69e-e15e0a99c924 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:34.717486 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b40ada4e-2a87-4add-b69e-e15e0a99c924 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:34.717919 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b40ada4e-2a87-4add-b69e-e15e0a99c924 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:34.781165 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b40ada4e-2a87-4add-b69e-e15e0a99c924 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:34.789399 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b40ada4e-2a87-4add-b69e-e15e0a99c924 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1308 microversion: 2.1 time: 0.084908 Aug 02 09:06:34.789954 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 461/921] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:34 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:35.812064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0c187a83-a823-44bd-a72d-b39bad378594 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:35.813649 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0c187a83-a823-44bd-a72d-b39bad378594 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:35.820948 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0c187a83-a823-44bd-a72d-b39bad378594 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:35.821520 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0c187a83-a823-44bd-a72d-b39bad378594 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:35.822401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0c187a83-a823-44bd-a72d-b39bad378594 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:35.822967 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0c187a83-a823-44bd-a72d-b39bad378594 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:35.963692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0c187a83-a823-44bd-a72d-b39bad378594 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:35.971533 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0c187a83-a823-44bd-a72d-b39bad378594 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.164800 Aug 02 09:06:35.972283 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 461/922] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:35 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:36.994484 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-669f196d-0f45-4a69-8b45-1c7de7ca0e3d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:36.996068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-669f196d-0f45-4a69-8b45-1c7de7ca0e3d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:37.005381 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-669f196d-0f45-4a69-8b45-1c7de7ca0e3d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:37.006157 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-669f196d-0f45-4a69-8b45-1c7de7ca0e3d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:37.007936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-669f196d-0f45-4a69-8b45-1c7de7ca0e3d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:37.008599 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-669f196d-0f45-4a69-8b45-1c7de7ca0e3d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:37.162140 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-669f196d-0f45-4a69-8b45-1c7de7ca0e3d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:37.171615 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-669f196d-0f45-4a69-8b45-1c7de7ca0e3d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.180882 Aug 02 09:06:37.173012 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 462/923] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:36 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:38.196841 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4364fe32-30c3-4835-8cd1-10718c1d8c64 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:38.198092 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4364fe32-30c3-4835-8cd1-10718c1d8c64 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:38.209248 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4364fe32-30c3-4835-8cd1-10718c1d8c64 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:38.220563 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4364fe32-30c3-4835-8cd1-10718c1d8c64 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:38.222052 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4364fe32-30c3-4835-8cd1-10718c1d8c64 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:38.222684 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4364fe32-30c3-4835-8cd1-10718c1d8c64 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:38.372914 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4364fe32-30c3-4835-8cd1-10718c1d8c64 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:38.380768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4364fe32-30c3-4835-8cd1-10718c1d8c64 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.188699 Aug 02 09:06:38.381414 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 462/924] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:38 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:39.403163 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f5c2171d-618d-411c-b052-deb10f9e2b17 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:39.403769 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f5c2171d-618d-411c-b052-deb10f9e2b17 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:39.410157 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5c2171d-618d-411c-b052-deb10f9e2b17 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:39.410610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5c2171d-618d-411c-b052-deb10f9e2b17 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:39.411379 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5c2171d-618d-411c-b052-deb10f9e2b17 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:39.411818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f5c2171d-618d-411c-b052-deb10f9e2b17 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:39.536575 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f5c2171d-618d-411c-b052-deb10f9e2b17 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:39.544515 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f5c2171d-618d-411c-b052-deb10f9e2b17 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.145203 Aug 02 09:06:39.545076 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 463/925] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:39 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:40.566312 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3f3afed6-41f4-4c7e-82e8-da8efd5e1aaa tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:40.566920 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3f3afed6-41f4-4c7e-82e8-da8efd5e1aaa tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:40.573154 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f3afed6-41f4-4c7e-82e8-da8efd5e1aaa tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.573601 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f3afed6-41f4-4c7e-82e8-da8efd5e1aaa tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.574367 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f3afed6-41f4-4c7e-82e8-da8efd5e1aaa tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.574796 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f3afed6-41f4-4c7e-82e8-da8efd5e1aaa tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.707727 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3f3afed6-41f4-4c7e-82e8-da8efd5e1aaa tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:40.715766 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3f3afed6-41f4-4c7e-82e8-da8efd5e1aaa tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.153307 Aug 02 09:06:40.716405 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 463/926] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:40 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:41.738924 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-542369b8-60c6-4014-bfb8-dea944d5c5eb tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:41.739488 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-542369b8-60c6-4014-bfb8-dea944d5c5eb tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:41.746888 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-542369b8-60c6-4014-bfb8-dea944d5c5eb tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.747336 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-542369b8-60c6-4014-bfb8-dea944d5c5eb tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.748105 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-542369b8-60c6-4014-bfb8-dea944d5c5eb tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.748561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-542369b8-60c6-4014-bfb8-dea944d5c5eb tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.892225 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-542369b8-60c6-4014-bfb8-dea944d5c5eb tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:41.900042 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-542369b8-60c6-4014-bfb8-dea944d5c5eb tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.165067 Aug 02 09:06:41.900895 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 464/927] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:41 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:42.922064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b5aa0782-c947-4d7f-a92b-f811c56742b9 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:42.922890 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b5aa0782-c947-4d7f-a92b-f811c56742b9 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:42.929407 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b5aa0782-c947-4d7f-a92b-f811c56742b9 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.929950 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b5aa0782-c947-4d7f-a92b-f811c56742b9 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.930797 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b5aa0782-c947-4d7f-a92b-f811c56742b9 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.931312 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b5aa0782-c947-4d7f-a92b-f811c56742b9 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.322238 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b5aa0782-c947-4d7f-a92b-f811c56742b9 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:43.330009 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b5aa0782-c947-4d7f-a92b-f811c56742b9 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.411982 Aug 02 09:06:43.330586 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 464/928] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:42 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:44.351004 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8a654c82-611b-467e-bb00-a75f87801252 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:44.351744 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8a654c82-611b-467e-bb00-a75f87801252 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:44.353989 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:44.354741 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=6 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:44.362270 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8a654c82-611b-467e-bb00-a75f87801252 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:44.362718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8a654c82-611b-467e-bb00-a75f87801252 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:44.363481 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8a654c82-611b-467e-bb00-a75f87801252 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:44.363915 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8a654c82-611b-467e-bb00-a75f87801252 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:44.511449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8a654c82-611b-467e-bb00-a75f87801252 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:44.519471 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8a654c82-611b-467e-bb00-a75f87801252 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.172390 Aug 02 09:06:44.519973 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 465/929] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:44 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:45.540656 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-26c69c63-d771-4c63-8592-2454b54b327e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:45.541271 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-26c69c63-d771-4c63-8592-2454b54b327e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:45.546370 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=6 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:45.548947 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26c69c63-d771-4c63-8592-2454b54b327e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.549396 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26c69c63-d771-4c63-8592-2454b54b327e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.550165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26c69c63-d771-4c63-8592-2454b54b327e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.550601 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-26c69c63-d771-4c63-8592-2454b54b327e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.681327 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-26c69c63-d771-4c63-8592-2454b54b327e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:45.688725 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-26c69c63-d771-4c63-8592-2454b54b327e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.151945 Aug 02 09:06:45.689288 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 465/930] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:45 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:46.710388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e3eea474-f276-420c-9ba3-f64ff6883d8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:46.711787 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e3eea474-f276-420c-9ba3-f64ff6883d8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:46.718991 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e3eea474-f276-420c-9ba3-f64ff6883d8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:46.719451 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e3eea474-f276-420c-9ba3-f64ff6883d8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:46.720270 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e3eea474-f276-420c-9ba3-f64ff6883d8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:46.720713 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e3eea474-f276-420c-9ba3-f64ff6883d8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:46.863663 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e3eea474-f276-420c-9ba3-f64ff6883d8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:46.872043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e3eea474-f276-420c-9ba3-f64ff6883d8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.165541 Aug 02 09:06:46.884080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 466/931] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:46 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:47.896329 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-682515db-2222-437c-908f-6e799484069e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:47.897008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-682515db-2222-437c-908f-6e799484069e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:47.905301 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-682515db-2222-437c-908f-6e799484069e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:47.906049 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-682515db-2222-437c-908f-6e799484069e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:47.907086 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-682515db-2222-437c-908f-6e799484069e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:47.907750 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-682515db-2222-437c-908f-6e799484069e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.058640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-682515db-2222-437c-908f-6e799484069e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:48.066152 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-682515db-2222-437c-908f-6e799484069e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.175540 Aug 02 09:06:48.066715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 466/932] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:47 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:49.088008 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-74e6bf70-eb6d-47bc-a94d-80301843868e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:49.088596 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-74e6bf70-eb6d-47bc-a94d-80301843868e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:49.095386 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74e6bf70-eb6d-47bc-a94d-80301843868e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.095846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74e6bf70-eb6d-47bc-a94d-80301843868e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.096648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74e6bf70-eb6d-47bc-a94d-80301843868e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.097090 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-74e6bf70-eb6d-47bc-a94d-80301843868e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.225770 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-74e6bf70-eb6d-47bc-a94d-80301843868e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:49.233200 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-74e6bf70-eb6d-47bc-a94d-80301843868e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.149850 Aug 02 09:06:49.233766 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 467/933] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:49 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:50.253241 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-e67d4f34-577c-4233-987a-87f2e685310d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:50.253788 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-e67d4f34-577c-4233-987a-87f2e685310d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:50.260895 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e67d4f34-577c-4233-987a-87f2e685310d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:50.261350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e67d4f34-577c-4233-987a-87f2e685310d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:50.262119 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e67d4f34-577c-4233-987a-87f2e685310d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:50.262559 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-e67d4f34-577c-4233-987a-87f2e685310d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:50.387065 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-e67d4f34-577c-4233-987a-87f2e685310d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:50.395849 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-e67d4f34-577c-4233-987a-87f2e685310d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.146558 Aug 02 09:06:50.396453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 467/934] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:50 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:51.418243 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-edfdbe8c-e847-40fc-8cac-c8f15ac743d3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:51.418860 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-edfdbe8c-e847-40fc-8cac-c8f15ac743d3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:51.425775 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-edfdbe8c-e847-40fc-8cac-c8f15ac743d3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.426228 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-edfdbe8c-e847-40fc-8cac-c8f15ac743d3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.426996 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-edfdbe8c-e847-40fc-8cac-c8f15ac743d3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.427433 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-edfdbe8c-e847-40fc-8cac-c8f15ac743d3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.552464 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-edfdbe8c-e847-40fc-8cac-c8f15ac743d3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:51.559926 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-edfdbe8c-e847-40fc-8cac-c8f15ac743d3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.145545 Aug 02 09:06:51.560521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 468/935] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:51 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:52.581583 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-00876555-fd2f-48d2-b2b3-b3ba27deeb7a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:52.582230 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-00876555-fd2f-48d2-b2b3-b3ba27deeb7a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:52.589324 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-00876555-fd2f-48d2-b2b3-b3ba27deeb7a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:52.589773 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-00876555-fd2f-48d2-b2b3-b3ba27deeb7a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:52.590540 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-00876555-fd2f-48d2-b2b3-b3ba27deeb7a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:52.590980 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-00876555-fd2f-48d2-b2b3-b3ba27deeb7a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:52.716308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-00876555-fd2f-48d2-b2b3-b3ba27deeb7a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:52.723749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-00876555-fd2f-48d2-b2b3-b3ba27deeb7a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.146020 Aug 02 09:06:52.724348 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 468/936] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:52 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:53.746209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d7cd07e5-4b34-4a69-afb1-7cfc894287d1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:53.746795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d7cd07e5-4b34-4a69-afb1-7cfc894287d1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:53.754838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7cd07e5-4b34-4a69-afb1-7cfc894287d1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.755302 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7cd07e5-4b34-4a69-afb1-7cfc894287d1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.756277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7cd07e5-4b34-4a69-afb1-7cfc894287d1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.756592 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d7cd07e5-4b34-4a69-afb1-7cfc894287d1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.953052 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-b0820d16-f3f9-4a2f-8580-92adc184fa47 req-2d16df05-f1ad-4650-812b-cc685300ea7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc288d38-55ce-4311-80be-0fe2d9d8ec3b", "tag": "31650346-e504-4a70-a71d-069e0ce03778"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:53.954565 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d7cd07e5-4b34-4a69-afb1-7cfc894287d1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:53.962795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d7cd07e5-4b34-4a69-afb1-7cfc894287d1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.221151 Aug 02 09:06:53.963727 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 469/937] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:53 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:53.963874 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b0820d16-f3f9-4a2f-8580-92adc184fa47 req-2d16df05-f1ad-4650-812b-cc685300ea7f service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.963981 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b0820d16-f3f9-4a2f-8580-92adc184fa47 req-2d16df05-f1ad-4650-812b-cc685300ea7f service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.977478 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-b0820d16-f3f9-4a2f-8580-92adc184fa47 req-2d16df05-f1ad-4650-812b-cc685300ea7f service nova] Creating event network-changed:31650346-e504-4a70-a71d-069e0ce03778 for instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b on hv-cinder-78729 Aug 02 09:06:53.983354 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-b0820d16-f3f9-4a2f-8580-92adc184fa47 req-2d16df05-f1ad-4650-812b-cc685300ea7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034185 Aug 02 09:06:53.983967 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 469/938] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:06:54.982786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-26fa0e12-b1b0-4ce7-ac80-51715b1d92b0 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:54.983405 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-26fa0e12-b1b0-4ce7-ac80-51715b1d92b0 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:54.990345 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-26fa0e12-b1b0-4ce7-ac80-51715b1d92b0 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.990785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-26fa0e12-b1b0-4ce7-ac80-51715b1d92b0 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.991555 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-26fa0e12-b1b0-4ce7-ac80-51715b1d92b0 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.992585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-26fa0e12-b1b0-4ce7-ac80-51715b1d92b0 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:55.120672 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-26fa0e12-b1b0-4ce7-ac80-51715b1d92b0 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:55.128061 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-26fa0e12-b1b0-4ce7-ac80-51715b1d92b0 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.149135 Aug 02 09:06:55.128651 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 470/939] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:54 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:56.150528 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-24f1b3a6-9d34-45e7-8c40-8d9c83e12132 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:56.151143 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-24f1b3a6-9d34-45e7-8c40-8d9c83e12132 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:56.157415 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-24f1b3a6-9d34-45e7-8c40-8d9c83e12132 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:56.157865 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-24f1b3a6-9d34-45e7-8c40-8d9c83e12132 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:56.158622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-24f1b3a6-9d34-45e7-8c40-8d9c83e12132 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:56.159060 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-24f1b3a6-9d34-45e7-8c40-8d9c83e12132 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:56.286317 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-24f1b3a6-9d34-45e7-8c40-8d9c83e12132 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:56.294148 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-24f1b3a6-9d34-45e7-8c40-8d9c83e12132 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.148941 Aug 02 09:06:56.294711 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 470/940] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:56 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:57.314934 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b559540c-0a3e-4e16-903b-d4d472253860 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:57.315549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b559540c-0a3e-4e16-903b-d4d472253860 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:57.322661 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b559540c-0a3e-4e16-903b-d4d472253860 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.323113 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b559540c-0a3e-4e16-903b-d4d472253860 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.323884 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b559540c-0a3e-4e16-903b-d4d472253860 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.324354 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b559540c-0a3e-4e16-903b-d4d472253860 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.451276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b559540c-0a3e-4e16-903b-d4d472253860 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:57.458792 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b559540c-0a3e-4e16-903b-d4d472253860 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.147743 Aug 02 09:06:57.459359 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 471/941] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:57 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:58.480863 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-10de04cd-95db-4e48-aa9d-a4bb76f10774 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:58.482496 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-10de04cd-95db-4e48-aa9d-a4bb76f10774 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:58.489370 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-10de04cd-95db-4e48-aa9d-a4bb76f10774 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.489821 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-10de04cd-95db-4e48-aa9d-a4bb76f10774 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.490595 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-10de04cd-95db-4e48-aa9d-a4bb76f10774 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.491037 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-10de04cd-95db-4e48-aa9d-a4bb76f10774 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.620385 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-10de04cd-95db-4e48-aa9d-a4bb76f10774 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:58.627743 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-10de04cd-95db-4e48-aa9d-a4bb76f10774 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.151595 Aug 02 09:06:58.628323 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 471/942] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:58 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:59.648695 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e186320d-f80e-483e-92a6-fc3df5d360a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:59.649802 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e186320d-f80e-483e-92a6-fc3df5d360a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:59.656381 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e186320d-f80e-483e-92a6-fc3df5d360a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:59.656837 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e186320d-f80e-483e-92a6-fc3df5d360a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:59.657646 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e186320d-f80e-483e-92a6-fc3df5d360a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:59.658088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e186320d-f80e-483e-92a6-fc3df5d360a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:59.787965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e186320d-f80e-483e-92a6-fc3df5d360a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:59.796062 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e186320d-f80e-483e-92a6-fc3df5d360a3 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.151218 Aug 02 09:06:59.796652 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 472/943] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:59 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:00.816883 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1e8e048f-968c-48b9-bd75-93bcd43846da tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:00.817490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1e8e048f-968c-48b9-bd75-93bcd43846da tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:00.824867 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1e8e048f-968c-48b9-bd75-93bcd43846da tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:00.825311 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1e8e048f-968c-48b9-bd75-93bcd43846da tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:00.826068 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1e8e048f-968c-48b9-bd75-93bcd43846da tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:00.826498 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1e8e048f-968c-48b9-bd75-93bcd43846da tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:00.953463 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1e8e048f-968c-48b9-bd75-93bcd43846da tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:00.960816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1e8e048f-968c-48b9-bd75-93bcd43846da tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.147808 Aug 02 09:07:00.961384 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 472/944] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:00 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:01.982488 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-df7b5e46-6512-477a-ac33-ba15a6aa03d2 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:01.983037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-df7b5e46-6512-477a-ac33-ba15a6aa03d2 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:01.989548 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df7b5e46-6512-477a-ac33-ba15a6aa03d2 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.989994 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df7b5e46-6512-477a-ac33-ba15a6aa03d2 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.990758 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df7b5e46-6512-477a-ac33-ba15a6aa03d2 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.991197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-df7b5e46-6512-477a-ac33-ba15a6aa03d2 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:02.119876 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-df7b5e46-6512-477a-ac33-ba15a6aa03d2 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:02.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-df7b5e46-6512-477a-ac33-ba15a6aa03d2 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.149691 Aug 02 09:07:02.128849 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 473/945] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:01 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:03.150054 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-31e95890-9ea5-406e-8c89-a73b2f0881e8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:03.151308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-31e95890-9ea5-406e-8c89-a73b2f0881e8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:03.153804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:03.160079 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-31e95890-9ea5-406e-8c89-a73b2f0881e8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.161406 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-31e95890-9ea5-406e-8c89-a73b2f0881e8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.162921 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-31e95890-9ea5-406e-8c89-a73b2f0881e8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.163641 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-31e95890-9ea5-406e-8c89-a73b2f0881e8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.168929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=69 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:03.318289 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-31e95890-9ea5-406e-8c89-a73b2f0881e8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:03.326920 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-31e95890-9ea5-406e-8c89-a73b2f0881e8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.181170 Aug 02 09:07:03.327499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 473/946] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:03 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:04.347847 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-22e06992-5334-49b3-9f9b-782d41c49ba8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:04.348504 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-22e06992-5334-49b3-9f9b-782d41c49ba8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:04.350805 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:04.356270 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-22e06992-5334-49b3-9f9b-782d41c49ba8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:04.356723 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-22e06992-5334-49b3-9f9b-782d41c49ba8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:04.357494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-22e06992-5334-49b3-9f9b-782d41c49ba8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:04.357933 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-22e06992-5334-49b3-9f9b-782d41c49ba8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:04.362796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=81 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:04.495130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-22e06992-5334-49b3-9f9b-782d41c49ba8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:04.503520 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-22e06992-5334-49b3-9f9b-782d41c49ba8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.159604 Aug 02 09:07:04.504169 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 474/947] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:04 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:05.362549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-b5cb59ff-9cab-4ebc-9f69-2efe7f9fab87 req-0f51326e-7a07-40d1-a100-1cf0a16f28c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc288d38-55ce-4311-80be-0fe2d9d8ec3b", "name": "network-vif-plugged", "status": "completed", "tag": "31650346-e504-4a70-a71d-069e0ce03778"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:05.372711 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b5cb59ff-9cab-4ebc-9f69-2efe7f9fab87 req-0f51326e-7a07-40d1-a100-1cf0a16f28c2 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.373190 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-b5cb59ff-9cab-4ebc-9f69-2efe7f9fab87 req-0f51326e-7a07-40d1-a100-1cf0a16f28c2 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.385818 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-b5cb59ff-9cab-4ebc-9f69-2efe7f9fab87 req-0f51326e-7a07-40d1-a100-1cf0a16f28c2 service nova] Creating event network-vif-plugged:31650346-e504-4a70-a71d-069e0ce03778 for instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b on hv-cinder-78729 Aug 02 09:07:05.390768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-b5cb59ff-9cab-4ebc-9f69-2efe7f9fab87 req-0f51326e-7a07-40d1-a100-1cf0a16f28c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Aug 02 09:07:05.391353 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 474/948] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:05.525043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3acb2274-c642-4285-900f-2a2e95dd9cf1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:05.526200 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3acb2274-c642-4285-900f-2a2e95dd9cf1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:05.532781 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3acb2274-c642-4285-900f-2a2e95dd9cf1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.533236 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3acb2274-c642-4285-900f-2a2e95dd9cf1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.534016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3acb2274-c642-4285-900f-2a2e95dd9cf1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.534633 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3acb2274-c642-4285-900f-2a2e95dd9cf1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.722027 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3acb2274-c642-4285-900f-2a2e95dd9cf1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:05.731441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3acb2274-c642-4285-900f-2a2e95dd9cf1 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.210224 Aug 02 09:07:05.732023 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 475/949] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:05 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:06.754500 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a1f19357-dc75-49e7-93ca-e7014326cb34 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:06.756207 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a1f19357-dc75-49e7-93ca-e7014326cb34 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:06.763070 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a1f19357-dc75-49e7-93ca-e7014326cb34 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:06.763527 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a1f19357-dc75-49e7-93ca-e7014326cb34 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:06.764351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a1f19357-dc75-49e7-93ca-e7014326cb34 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:06.764793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a1f19357-dc75-49e7-93ca-e7014326cb34 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:06.904937 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a1f19357-dc75-49e7-93ca-e7014326cb34 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:06.912449 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a1f19357-dc75-49e7-93ca-e7014326cb34 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.162717 Aug 02 09:07:06.913017 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 475/950] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:06 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:07.934188 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a27daa65-0022-41bd-aa1e-3f30bd474b42 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:07.934842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a27daa65-0022-41bd-aa1e-3f30bd474b42 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:07.941354 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a27daa65-0022-41bd-aa1e-3f30bd474b42 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.941808 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a27daa65-0022-41bd-aa1e-3f30bd474b42 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.942594 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a27daa65-0022-41bd-aa1e-3f30bd474b42 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.943037 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a27daa65-0022-41bd-aa1e-3f30bd474b42 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:08.155176 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-a27daa65-0022-41bd-aa1e-3f30bd474b42 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:08.164602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a27daa65-0022-41bd-aa1e-3f30bd474b42 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.234407 Aug 02 09:07:08.166119 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 476/951] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:07 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:09.186656 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-995f00f8-6911-44e1-a860-57478fe657ba tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:09.187307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-995f00f8-6911-44e1-a860-57478fe657ba tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:09.193907 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-995f00f8-6911-44e1-a860-57478fe657ba tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.194351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-995f00f8-6911-44e1-a860-57478fe657ba tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.195121 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-995f00f8-6911-44e1-a860-57478fe657ba tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.195558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-995f00f8-6911-44e1-a860-57478fe657ba tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.398820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-995f00f8-6911-44e1-a860-57478fe657ba tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:09.406591 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-995f00f8-6911-44e1-a860-57478fe657ba tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1545 microversion: 2.1 time: 0.224080 Aug 02 09:07:09.407366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 476/952] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:09 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1545 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:09.426927 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-464ada57-d6e9-4fac-a0fc-3514cf0df9cc tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:09.427690 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-464ada57-d6e9-4fac-a0fc-3514cf0df9cc tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:09.434810 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-464ada57-d6e9-4fac-a0fc-3514cf0df9cc tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.435264 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-464ada57-d6e9-4fac-a0fc-3514cf0df9cc tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.436049 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-464ada57-d6e9-4fac-a0fc-3514cf0df9cc tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.436519 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-464ada57-d6e9-4fac-a0fc-3514cf0df9cc tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.678143 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-464ada57-d6e9-4fac-a0fc-3514cf0df9cc tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:09.686591 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-464ada57-d6e9-4fac-a0fc-3514cf0df9cc tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1545 microversion: 2.1 time: 0.263306 Aug 02 09:07:09.695034 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 477/953] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:09 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1545 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:09.706686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:09.711327 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:09.712096 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Searching by: {'deleted': False, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c'} {{(pid=117772) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 09:07:09.719375 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.719866 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.720715 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.721175 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.818182 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.multi_cell_list [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 09:07:10.070476 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3d6ec3b9-69b0-4f82-b9a2-ea2ba1e2e7ce tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.367490 Aug 02 09:07:10.071060 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 477/954] 10.222.0.17 () {58 vars in 1125 bytes} [Tue Aug 2 09:07:09 2022] GET /compute/v2.1/servers => generated 341 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:10.082513 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7b1b55e3-6197-4c56-8d7c-fbd72f46900c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:10.083128 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7b1b55e3-6197-4c56-8d7c-fbd72f46900c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:10.089719 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7b1b55e3-6197-4c56-8d7c-fbd72f46900c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.090167 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7b1b55e3-6197-4c56-8d7c-fbd72f46900c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.090930 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7b1b55e3-6197-4c56-8d7c-fbd72f46900c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.091365 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7b1b55e3-6197-4c56-8d7c-fbd72f46900c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.232549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7b1b55e3-6197-4c56-8d7c-fbd72f46900c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:10.244721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7b1b55e3-6197-4c56-8d7c-fbd72f46900c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1545 microversion: 2.1 time: 0.165708 Aug 02 09:07:10.245473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 478/955] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:10 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1545 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:11.415740 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-637840592", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "networks": [{"uuid": "bbe8d88f-916d-4d3e-b380-611fffde43aa"}]}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:11.468500 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] validate_networks() for [('bbe8d88f-916d-4d3e-b380-611fffde43aa', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:07:11.874664 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:07:11.875080 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:07:11.875579 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:07:11.875980 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:07:11.876409 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:07:11.885836 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:11.886274 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.887200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:11.887632 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.904267 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Getting quotas for project 79cf9558cd344c639e5f1a2051364659. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:07:11.908155 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Getting quotas for user a7d34b23e862400bbf082a0578708a4b and project 79cf9558cd344c639e5f1a2051364659. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:07:11.918746 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:07:11.921043 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:07:11.967001 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2138f56a-b709-448a-8e7e-81d3cda5797a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555070 Aug 02 09:07:11.971126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 478/956] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:07:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:07:11.978284 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1772e3df-edfb-493b-8ab9-ff93f9dc81f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:11.978948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1772e3df-edfb-493b-8ab9-ff93f9dc81f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:12.032322 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1772e3df-edfb-493b-8ab9-ff93f9dc81f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:12.038877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1772e3df-edfb-493b-8ab9-ff93f9dc81f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1213 microversion: 2.1 time: 0.064460 Aug 02 09:07:12.039440 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 479/957] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:11 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:12.849217 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-cd5a16db-38d7-4963-baed-6cf112ca448b tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:12.851574 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-cd5a16db-38d7-4963-baed-6cf112ca448b tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:12.859203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cd5a16db-38d7-4963-baed-6cf112ca448b tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.859656 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cd5a16db-38d7-4963-baed-6cf112ca448b tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.860463 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cd5a16db-38d7-4963-baed-6cf112ca448b tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.860902 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-cd5a16db-38d7-4963-baed-6cf112ca448b tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:13.058759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1fad96bb-3230-455d-89c1-d0defd45737b tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:13.059417 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1fad96bb-3230-455d-89c1-d0defd45737b tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:13.072716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1fad96bb-3230-455d-89c1-d0defd45737b tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:13.073463 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1fad96bb-3230-455d-89c1-d0defd45737b tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:13.074703 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1fad96bb-3230-455d-89c1-d0defd45737b tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:13.075149 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1fad96bb-3230-455d-89c1-d0defd45737b tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:13.149181 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1fad96bb-3230-455d-89c1-d0defd45737b tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:13.158731 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1fad96bb-3230-455d-89c1-d0defd45737b tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1273 microversion: 2.1 time: 0.103805 Aug 02 09:07:13.160052 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 480/958] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:13 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:13.205402 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-cd5a16db-38d7-4963-baed-6cf112ca448b tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "POST /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360514 Aug 02 09:07:13.206043 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 479/959] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 2 09:07:12 2022] POST /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:14.180853 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-19ae35d4-8e1e-4a92-8493-097fc5d4e29c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:14.182010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-19ae35d4-8e1e-4a92-8493-097fc5d4e29c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:14.188704 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19ae35d4-8e1e-4a92-8493-097fc5d4e29c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.189158 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19ae35d4-8e1e-4a92-8493-097fc5d4e29c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.189932 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19ae35d4-8e1e-4a92-8493-097fc5d4e29c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.190377 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-19ae35d4-8e1e-4a92-8493-097fc5d4e29c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.393928 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-19ae35d4-8e1e-4a92-8493-097fc5d4e29c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:14.401547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-19ae35d4-8e1e-4a92-8493-097fc5d4e29c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1313 microversion: 2.1 time: 0.224488 Aug 02 09:07:14.402277 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 481/960] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:14 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:14.463465 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-4ef0df0e-3b9b-4da2-b6de-7d9a6271bf87 req-fd36eca1-dabc-43a8-b1fd-18ea21335087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de719a61-bd01-4eda-9eb1-2f805e900e1a", "tag": "e2777c9f-a83e-4e73-9fea-f0df809fc386"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:14.474200 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-4ef0df0e-3b9b-4da2-b6de-7d9a6271bf87 req-fd36eca1-dabc-43a8-b1fd-18ea21335087 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.474728 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-4ef0df0e-3b9b-4da2-b6de-7d9a6271bf87 req-fd36eca1-dabc-43a8-b1fd-18ea21335087 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.487177 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-4ef0df0e-3b9b-4da2-b6de-7d9a6271bf87 req-fd36eca1-dabc-43a8-b1fd-18ea21335087 service nova] Creating event network-changed:e2777c9f-a83e-4e73-9fea-f0df809fc386 for instance de719a61-bd01-4eda-9eb1-2f805e900e1a on hv-cinder-78729 Aug 02 09:07:14.491893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-4ef0df0e-3b9b-4da2-b6de-7d9a6271bf87 req-fd36eca1-dabc-43a8-b1fd-18ea21335087 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032993 Aug 02 09:07:14.492532 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 480/961] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:15.422217 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e480bcb7-dffe-4bfc-913a-9f72b54798e2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:15.422836 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e480bcb7-dffe-4bfc-913a-9f72b54798e2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:15.429408 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e480bcb7-dffe-4bfc-913a-9f72b54798e2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:15.429862 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e480bcb7-dffe-4bfc-913a-9f72b54798e2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.430637 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e480bcb7-dffe-4bfc-913a-9f72b54798e2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:15.431574 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e480bcb7-dffe-4bfc-913a-9f72b54798e2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.563967 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e480bcb7-dffe-4bfc-913a-9f72b54798e2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:15.571469 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e480bcb7-dffe-4bfc-913a-9f72b54798e2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1313 microversion: 2.1 time: 0.153094 Aug 02 09:07:15.572689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 482/962] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:15 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:16.593588 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1651c295-2d67-4d19-a97d-34ce3e5649f2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:16.594288 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1651c295-2d67-4d19-a97d-34ce3e5649f2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:16.600490 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1651c295-2d67-4d19-a97d-34ce3e5649f2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.600938 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1651c295-2d67-4d19-a97d-34ce3e5649f2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.601704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1651c295-2d67-4d19-a97d-34ce3e5649f2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.602137 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1651c295-2d67-4d19-a97d-34ce3e5649f2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.730440 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1651c295-2d67-4d19-a97d-34ce3e5649f2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:16.738056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1651c295-2d67-4d19-a97d-34ce3e5649f2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1313 microversion: 2.1 time: 0.149103 Aug 02 09:07:16.738922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 481/963] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:16 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:17.760851 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c07e7db8-b92f-4d21-8ffc-9a9165d82f3c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:17.761464 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c07e7db8-b92f-4d21-8ffc-9a9165d82f3c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:17.767817 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c07e7db8-b92f-4d21-8ffc-9a9165d82f3c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:17.768307 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c07e7db8-b92f-4d21-8ffc-9a9165d82f3c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.769080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c07e7db8-b92f-4d21-8ffc-9a9165d82f3c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:17.769516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c07e7db8-b92f-4d21-8ffc-9a9165d82f3c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.898043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c07e7db8-b92f-4d21-8ffc-9a9165d82f3c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:17.906377 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c07e7db8-b92f-4d21-8ffc-9a9165d82f3c tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1313 microversion: 2.1 time: 0.149220 Aug 02 09:07:17.907347 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 483/964] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:17 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:18.927077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b46b657c-a97e-4d2b-930c-13c0a1d946f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:18.927688 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b46b657c-a97e-4d2b-930c-13c0a1d946f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:18.934956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b46b657c-a97e-4d2b-930c-13c0a1d946f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:18.935402 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b46b657c-a97e-4d2b-930c-13c0a1d946f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:18.936189 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b46b657c-a97e-4d2b-930c-13c0a1d946f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:18.936629 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-b46b657c-a97e-4d2b-930c-13c0a1d946f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:19.064829 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b46b657c-a97e-4d2b-930c-13c0a1d946f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:19.072193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b46b657c-a97e-4d2b-930c-13c0a1d946f5 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1313 microversion: 2.1 time: 0.148931 Aug 02 09:07:19.072757 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 482/965] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:18 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:19.371319 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-6ce05a85-e081-4280-bf09-439486734577 req-0a0be39a-f47b-42fe-b33a-1ade428a6f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de719a61-bd01-4eda-9eb1-2f805e900e1a", "name": "network-vif-plugged", "status": "completed", "tag": "e2777c9f-a83e-4e73-9fea-f0df809fc386"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:19.381781 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-6ce05a85-e081-4280-bf09-439486734577 req-0a0be39a-f47b-42fe-b33a-1ade428a6f31 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:19.382220 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-6ce05a85-e081-4280-bf09-439486734577 req-0a0be39a-f47b-42fe-b33a-1ade428a6f31 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:19.394147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-6ce05a85-e081-4280-bf09-439486734577 req-0a0be39a-f47b-42fe-b33a-1ade428a6f31 service nova] Creating event network-vif-plugged:e2777c9f-a83e-4e73-9fea-f0df809fc386 for instance de719a61-bd01-4eda-9eb1-2f805e900e1a on hv-cinder-78729 Aug 02 09:07:19.399243 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-6ce05a85-e081-4280-bf09-439486734577 req-0a0be39a-f47b-42fe-b33a-1ade428a6f31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031630 Aug 02 09:07:19.400523 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 484/966] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:20.092571 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8eb3d705-609e-4da0-91bc-7134d7c2859e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:20.093203 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8eb3d705-609e-4da0-91bc-7134d7c2859e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:20.099647 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eb3d705-609e-4da0-91bc-7134d7c2859e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.100091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eb3d705-609e-4da0-91bc-7134d7c2859e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.100880 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eb3d705-609e-4da0-91bc-7134d7c2859e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.101347 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8eb3d705-609e-4da0-91bc-7134d7c2859e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.232661 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8eb3d705-609e-4da0-91bc-7134d7c2859e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:20.239952 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8eb3d705-609e-4da0-91bc-7134d7c2859e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1313 microversion: 2.1 time: 0.151244 Aug 02 09:07:20.240530 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 483/967] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:20 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:20.800239 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-93dff57c-91b7-4e02-8cd3-93cda35e87f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:20.800937 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-93dff57c-91b7-4e02-8cd3-93cda35e87f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:20.807577 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-93dff57c-91b7-4e02-8cd3-93cda35e87f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.808064 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-93dff57c-91b7-4e02-8cd3-93cda35e87f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.808846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-93dff57c-91b7-4e02-8cd3-93cda35e87f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.809281 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-93dff57c-91b7-4e02-8cd3-93cda35e87f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.935648 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-93dff57c-91b7-4e02-8cd3-93cda35e87f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:20.943463 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-93dff57c-91b7-4e02-8cd3-93cda35e87f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1591 microversion: 2.1 time: 0.147413 Aug 02 09:07:20.944021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 485/968] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:20 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1591 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:21.261967 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f3b1dc8a-0be5-4472-b3e1-7a2ca451a4a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:21.262498 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f3b1dc8a-0be5-4472-b3e1-7a2ca451a4a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:21.268985 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f3b1dc8a-0be5-4472-b3e1-7a2ca451a4a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:21.269438 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f3b1dc8a-0be5-4472-b3e1-7a2ca451a4a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:21.270212 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f3b1dc8a-0be5-4472-b3e1-7a2ca451a4a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:21.270666 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f3b1dc8a-0be5-4472-b3e1-7a2ca451a4a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:21.402889 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f3b1dc8a-0be5-4472-b3e1-7a2ca451a4a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:21.410281 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f3b1dc8a-0be5-4472-b3e1-7a2ca451a4a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1313 microversion: 2.1 time: 0.152917 Aug 02 09:07:21.410860 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 484/969] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:21 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:22.432317 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8d1d922c-d986-40ca-80c5-4294967da799 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:22.433818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8d1d922c-d986-40ca-80c5-4294967da799 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:22.440135 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:22.442211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8d1d922c-d986-40ca-80c5-4294967da799 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:22.442988 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8d1d922c-d986-40ca-80c5-4294967da799 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:22.443913 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8d1d922c-d986-40ca-80c5-4294967da799 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:22.444667 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8d1d922c-d986-40ca-80c5-4294967da799 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:22.910473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8d1d922c-d986-40ca-80c5-4294967da799 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:22.919580 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8d1d922c-d986-40ca-80c5-4294967da799 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1313 microversion: 2.1 time: 0.492490 Aug 02 09:07:22.921261 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 486/970] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:22 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1313 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:22.954006 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-cec0ac9b-62f6-47bd-9697-dec97ca82ffe req-1545774f-3904-4fd7-a36f-bea3c2c78dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc288d38-55ce-4311-80be-0fe2d9d8ec3b", "tag": "31650346-e504-4a70-a71d-069e0ce03778"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:22.962669 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=4 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:22.963743 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=6 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:22.967971 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-cec0ac9b-62f6-47bd-9697-dec97ca82ffe req-1545774f-3904-4fd7-a36f-bea3c2c78dbf service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:22.968457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-cec0ac9b-62f6-47bd-9697-dec97ca82ffe req-1545774f-3904-4fd7-a36f-bea3c2c78dbf service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:22.981772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-cec0ac9b-62f6-47bd-9697-dec97ca82ffe req-1545774f-3904-4fd7-a36f-bea3c2c78dbf service nova] Creating event network-changed:31650346-e504-4a70-a71d-069e0ce03778 for instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b on hv-cinder-78729 Aug 02 09:07:22.986914 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-cec0ac9b-62f6-47bd-9697-dec97ca82ffe req-1545774f-3904-4fd7-a36f-bea3c2c78dbf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036506 Aug 02 09:07:22.987640 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 485/971] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:23.943466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-07f110f1-0723-4455-9e1e-f664015936d1 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:23.944245 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-07f110f1-0723-4455-9e1e-f664015936d1 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:23.952468 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-07f110f1-0723-4455-9e1e-f664015936d1 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.953036 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-07f110f1-0723-4455-9e1e-f664015936d1 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.954095 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-07f110f1-0723-4455-9e1e-f664015936d1 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.954620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-07f110f1-0723-4455-9e1e-f664015936d1 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.003158 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-561c7703-e7b6-4b07-b4b8-625590d92b98 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-198109230"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:24.010313 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-561c7703-e7b6-4b07-b4b8-625590d92b98 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:24.017173 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-561c7703-e7b6-4b07-b4b8-625590d92b98 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.017718 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-561c7703-e7b6-4b07-b4b8-625590d92b98 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.018578 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-561c7703-e7b6-4b07-b4b8-625590d92b98 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.019097 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-561c7703-e7b6-4b07-b4b8-625590d92b98 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.110118 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-07f110f1-0723-4455-9e1e-f664015936d1 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:24.117857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-07f110f1-0723-4455-9e1e-f664015936d1 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1497 microversion: 2.1 time: 0.179310 Aug 02 09:07:24.119422 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 487/972] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:23 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:24.155858 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.network.security_group_api [None req-561c7703-e7b6-4b07-b4b8-625590d92b98 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Adding security group 36b9d584-4982-443b-a805-9de8b5246ab7 to port 31650346-e504-4a70-a71d-069e0ce03778 Aug 02 09:07:24.472643 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-561c7703-e7b6-4b07-b4b8-625590d92b98 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "POST /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/action" status: 202 len: 0 microversion: 2.1 time: 0.474864 Aug 02 09:07:24.476613 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 486/973] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 09:07:23 2022] POST /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:07:24.483853 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-1ce176c7-e163-43c7-a6d5-29b650b91d1e req-a7526003-3fe6-46bc-9c0c-dddc339d1799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc288d38-55ce-4311-80be-0fe2d9d8ec3b", "tag": "31650346-e504-4a70-a71d-069e0ce03778"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:24.485211 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1d70d881-9b1c-4b4b-a75c-a7e3723eff88 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:24.486056 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1d70d881-9b1c-4b4b-a75c-a7e3723eff88 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:24.493888 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1ce176c7-e163-43c7-a6d5-29b650b91d1e req-a7526003-3fe6-46bc-9c0c-dddc339d1799 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.494415 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1ce176c7-e163-43c7-a6d5-29b650b91d1e req-a7526003-3fe6-46bc-9c0c-dddc339d1799 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.498276 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d70d881-9b1c-4b4b-a75c-a7e3723eff88 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.498723 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d70d881-9b1c-4b4b-a75c-a7e3723eff88 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.499679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d70d881-9b1c-4b4b-a75c-a7e3723eff88 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.500147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1d70d881-9b1c-4b4b-a75c-a7e3723eff88 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.506751 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-1ce176c7-e163-43c7-a6d5-29b650b91d1e req-a7526003-3fe6-46bc-9c0c-dddc339d1799 service nova] Creating event network-changed:31650346-e504-4a70-a71d-069e0ce03778 for instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b on hv-cinder-78729 Aug 02 09:07:24.511723 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-1ce176c7-e163-43c7-a6d5-29b650b91d1e req-a7526003-3fe6-46bc-9c0c-dddc339d1799 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031703 Aug 02 09:07:24.512659 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 487/974] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:24.732861 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1d70d881-9b1c-4b4b-a75c-a7e3723eff88 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:24.742581 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1d70d881-9b1c-4b4b-a75c-a7e3723eff88 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1755 microversion: 2.1 time: 0.261830 Aug 02 09:07:24.743760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 488/975] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:24 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1755 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:24.886613 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f26440ce-6845-4b44-bab9-49c88b26140a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:24.887423 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f26440ce-6845-4b44-bab9-49c88b26140a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:24.894038 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f26440ce-6845-4b44-bab9-49c88b26140a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.894700 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f26440ce-6845-4b44-bab9-49c88b26140a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.895651 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f26440ce-6845-4b44-bab9-49c88b26140a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.896271 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f26440ce-6845-4b44-bab9-49c88b26140a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.923841 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f26440ce-6845-4b44-bab9-49c88b26140a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:07:25.013421 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f26440ce-6845-4b44-bab9-49c88b26140a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "DELETE /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 204 len: 0 microversion: 2.1 time: 0.130473 Aug 02 09:07:25.016162 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 488/976] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:07:24 2022] DELETE /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:07:25.023993 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6f70f694-530f-451d-84b8-b836aae6c9b4 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:25.026108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6f70f694-530f-451d-84b8-b836aae6c9b4 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:25.033273 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6f70f694-530f-451d-84b8-b836aae6c9b4 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.033956 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6f70f694-530f-451d-84b8-b836aae6c9b4 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.034804 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6f70f694-530f-451d-84b8-b836aae6c9b4 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.035650 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6f70f694-530f-451d-84b8-b836aae6c9b4 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.175002 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6f70f694-530f-451d-84b8-b836aae6c9b4 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:25.183356 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6f70f694-530f-451d-84b8-b836aae6c9b4 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1503 microversion: 2.1 time: 0.163639 Aug 02 09:07:25.183920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 489/977] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:25 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:26.205905 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-776215fc-1449-46fb-a901-c81d58715742 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:26.206542 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-776215fc-1449-46fb-a901-c81d58715742 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:26.216350 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-776215fc-1449-46fb-a901-c81d58715742 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:26.216797 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-776215fc-1449-46fb-a901-c81d58715742 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:26.217560 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-776215fc-1449-46fb-a901-c81d58715742 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:26.217989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-776215fc-1449-46fb-a901-c81d58715742 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:26.344950 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-776215fc-1449-46fb-a901-c81d58715742 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:26.352371 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-776215fc-1449-46fb-a901-c81d58715742 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1503 microversion: 2.1 time: 0.150814 Aug 02 09:07:26.353026 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 489/978] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:26 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:27.373465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-57e1f93c-e2f8-44b5-8ed8-5dc658c54bc2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:27.374080 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-57e1f93c-e2f8-44b5-8ed8-5dc658c54bc2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:27.380641 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-57e1f93c-e2f8-44b5-8ed8-5dc658c54bc2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:27.381094 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-57e1f93c-e2f8-44b5-8ed8-5dc658c54bc2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:27.381846 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-57e1f93c-e2f8-44b5-8ed8-5dc658c54bc2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:27.382287 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-57e1f93c-e2f8-44b5-8ed8-5dc658c54bc2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:27.548679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-57e1f93c-e2f8-44b5-8ed8-5dc658c54bc2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:27.556215 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-57e1f93c-e2f8-44b5-8ed8-5dc658c54bc2 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1503 microversion: 2.1 time: 0.186651 Aug 02 09:07:27.556998 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 490/979] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:27 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:27.954800 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-1e3e9984-b9e7-4aaa-8e06-3d7742699e3c req-bb293860-eaa4-4e74-8af1-a97f53b132f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de719a61-bd01-4eda-9eb1-2f805e900e1a", "name": "network-vif-deleted", "tag": "e2777c9f-a83e-4e73-9fea-f0df809fc386"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:27.965692 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1e3e9984-b9e7-4aaa-8e06-3d7742699e3c req-bb293860-eaa4-4e74-8af1-a97f53b132f9 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:27.966154 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-1e3e9984-b9e7-4aaa-8e06-3d7742699e3c req-bb293860-eaa4-4e74-8af1-a97f53b132f9 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:27.969957 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:27.978338 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-1e3e9984-b9e7-4aaa-8e06-3d7742699e3c req-bb293860-eaa4-4e74-8af1-a97f53b132f9 service nova] Creating event network-vif-deleted:e2777c9f-a83e-4e73-9fea-f0df809fc386 for instance de719a61-bd01-4eda-9eb1-2f805e900e1a on hv-cinder-78729 Aug 02 09:07:27.983252 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-1e3e9984-b9e7-4aaa-8e06-3d7742699e3c req-bb293860-eaa4-4e74-8af1-a97f53b132f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032199 Aug 02 09:07:27.983941 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 490/980] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:28.577729 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:28.578333 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:28.585388 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:28.585839 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:28.586610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:28.587131 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:28.620597 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:28.621065 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:28.621501 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lazy-loading 'fault' on Instance uuid de719a61-bd01-4eda-9eb1-2f805e900e1a {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:07:28.662819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:28.670069 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-60444bcc-fc85-48db-9193-a1d2e80caa07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 200 len: 1303 microversion: 2.1 time: 0.096543 Aug 02 09:07:28.670619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 491/981] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:28 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:29.693247 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:29.693950 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: de719a61-bd01-4eda-9eb1-2f805e900e1a] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:29.701435 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:29.701886 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:29.702656 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:29.703098 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:29.716511 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] HTTP exception thrown: Instance de719a61-bd01-4eda-9eb1-2f805e900e1a could not be found. Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Request method failure captured: Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a HTTP/1.1 Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6Ok9UQXpEZ3vAOT1XLtkeNMjSyh0CLEPa2wPeLmP-9c0XXPmlbvNLl6d6JXTKKZTa6gkLCxEnd_vc72_ocOko19MUv7s99J0V-lj4FwGjfwB9WIOZCHsUR7WmtpCD6OPQQWy4NveIy3PuPMzEg7yZjKj1GvCSh3DPWQDLzivqhE-fNk Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 79cf9558cd344c639e5f1a2051364659 Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-VolumesActionsTest-1231312339 Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:07:29.718206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_79cf9558cd344c639e5f1a2051364659", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/79cf9558cd344c639e5f1a2051364659"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/79cf9558cd344c639e5f1a2051364659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/79cf9558cd344c639e5f1a2051364659"}]}] Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-VolumesActionsTest-1231312339 Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 79cf9558cd344c639e5f1a2051364659 Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-VolumesActionsTest-1231312339 Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-VolumesActionsTest-1231312339-project Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: a7d34b23e862400bbf082a0578708a4b Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-VolumesActionsTest-1231312339-project Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance de719a61-bd01-4eda-9eb1-2f805e900e1a could not be found. Aug 02 09:07:29.720025 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'de719a61-bd01-4eda-9eb1-2f805e900e1a'} Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de719a61-bd01-4eda-9eb1-2f805e900e1a could not be found. Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:07:29.721083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de719a61-bd01-4eda-9eb1-2f805e900e1a could not be found. Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de719a61-bd01-4eda-9eb1-2f805e900e1a could not be found. Aug 02 09:07:29.722782 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:07:29.724132 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Returning 404 to user: Instance de719a61-bd01-4eda-9eb1-2f805e900e1a could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:07:29.724132 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-043f6279-8fb2-444b-86aa-4f34da754819 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a" status: 404 len: 111 microversion: 2.1 time: 0.031857 Aug 02 09:07:29.724132 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 491/982] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:29 2022] GET /compute/v2.1/servers/de719a61-bd01-4eda-9eb1-2f805e900e1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:07:29.824614 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1553522674", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452", "networks": [{"uuid": "bbe8d88f-916d-4d3e-b380-611fffde43aa"}]}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:29.876547 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] validate_networks() for [('bbe8d88f-916d-4d3e-b380-611fffde43aa', None, None, None, None, None)] {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:07:30.220081 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:07:30.220541 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:07:30.221018 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:07:30.221423 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:07:30.221886 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:07:30.231175 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:30.231621 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:30.232455 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:30.232890 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:30.239530 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=100 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:30.251047 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Getting quotas for project 79cf9558cd344c639e5f1a2051364659. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:07:30.255086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Getting quotas for user a7d34b23e862400bbf082a0578708a4b and project 79cf9558cd344c639e5f1a2051364659. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:07:30.265813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:07:30.268031 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:07:30.311744 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c8746a59-9ad9-4d91-b260-b64f0fd9b215 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491908 Aug 02 09:07:30.312602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 492/983] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:07:30.323416 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a927692e-aa01-4178-9f5f-0e33d6e1df07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:30.324330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a927692e-aa01-4178-9f5f-0e33d6e1df07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:30.380486 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a927692e-aa01-4178-9f5f-0e33d6e1df07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:30.388000 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a927692e-aa01-4178-9f5f-0e33d6e1df07 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1214 microversion: 2.1 time: 0.068420 Aug 02 09:07:30.388606 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 492/984] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:30 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:31.409580 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5f13376f-b9c1-469c-97b3-691cc092fb24 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:31.410187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5f13376f-b9c1-469c-97b3-691cc092fb24 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:31.417548 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5f13376f-b9c1-469c-97b3-691cc092fb24 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:31.417985 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5f13376f-b9c1-469c-97b3-691cc092fb24 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:31.418740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5f13376f-b9c1-469c-97b3-691cc092fb24 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:31.419171 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5f13376f-b9c1-469c-97b3-691cc092fb24 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:31.480078 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5f13376f-b9c1-469c-97b3-691cc092fb24 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:31.488494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5f13376f-b9c1-469c-97b3-691cc092fb24 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1266 microversion: 2.1 time: 0.083214 Aug 02 09:07:31.489031 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 493/985] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:31 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:32.510667 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6d10c44c-849f-4745-9e07-8a96b818d59a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:32.511394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6d10c44c-849f-4745-9e07-8a96b818d59a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:32.518611 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d10c44c-849f-4745-9e07-8a96b818d59a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:32.519064 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d10c44c-849f-4745-9e07-8a96b818d59a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:32.519867 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d10c44c-849f-4745-9e07-8a96b818d59a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:32.520343 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6d10c44c-849f-4745-9e07-8a96b818d59a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:32.658361 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6d10c44c-849f-4745-9e07-8a96b818d59a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:32.667779 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6d10c44c-849f-4745-9e07-8a96b818d59a tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1314 microversion: 2.1 time: 0.161467 Aug 02 09:07:32.668398 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 493/986] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:32 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:33.062296 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-39591caf-754f-4ed4-b1c1-dc7f1cdee7b8 req-4d9a5c6d-56a2-4e24-929a-8e1a1d7d5955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b8234b-52c9-42e4-8399-c7af16be35a0", "tag": "0fb4a18d-991a-4db0-8ce7-e7f502d6532f"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:33.072803 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-39591caf-754f-4ed4-b1c1-dc7f1cdee7b8 req-4d9a5c6d-56a2-4e24-929a-8e1a1d7d5955 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:33.073253 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-39591caf-754f-4ed4-b1c1-dc7f1cdee7b8 req-4d9a5c6d-56a2-4e24-929a-8e1a1d7d5955 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:33.087593 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-39591caf-754f-4ed4-b1c1-dc7f1cdee7b8 req-4d9a5c6d-56a2-4e24-929a-8e1a1d7d5955 service nova] Creating event network-changed:0fb4a18d-991a-4db0-8ce7-e7f502d6532f for instance f3b8234b-52c9-42e4-8399-c7af16be35a0 on hv-cinder-78729 Aug 02 09:07:33.092707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-39591caf-754f-4ed4-b1c1-dc7f1cdee7b8 req-4d9a5c6d-56a2-4e24-929a-8e1a1d7d5955 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034217 Aug 02 09:07:33.093502 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 494/987] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:33.689322 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-fa5e2369-2c37-4d5f-91cd-3260e76b3be3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:33.689943 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-fa5e2369-2c37-4d5f-91cd-3260e76b3be3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:33.693447 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:33.698185 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fa5e2369-2c37-4d5f-91cd-3260e76b3be3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:33.698899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fa5e2369-2c37-4d5f-91cd-3260e76b3be3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:33.699666 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fa5e2369-2c37-4d5f-91cd-3260e76b3be3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:33.700104 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-fa5e2369-2c37-4d5f-91cd-3260e76b3be3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:33.835294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-fa5e2369-2c37-4d5f-91cd-3260e76b3be3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:33.843458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-fa5e2369-2c37-4d5f-91cd-3260e76b3be3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1314 microversion: 2.1 time: 0.158255 Aug 02 09:07:33.844013 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 494/988] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:33 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:34.865430 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-312534ca-3a80-40de-a38c-65e5beb8c9a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:34.866122 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-312534ca-3a80-40de-a38c-65e5beb8c9a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:34.868038 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:34.874344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-312534ca-3a80-40de-a38c-65e5beb8c9a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:34.874791 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-312534ca-3a80-40de-a38c-65e5beb8c9a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:34.875549 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-312534ca-3a80-40de-a38c-65e5beb8c9a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:34.875982 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-312534ca-3a80-40de-a38c-65e5beb8c9a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:35.010783 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-312534ca-3a80-40de-a38c-65e5beb8c9a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:35.018315 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-312534ca-3a80-40de-a38c-65e5beb8c9a7 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1314 microversion: 2.1 time: 0.157614 Aug 02 09:07:35.018897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 495/989] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:34 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:36.038566 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-9ba02443-1480-4c65-b51f-518a783cfe22 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:36.039179 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-9ba02443-1480-4c65-b51f-518a783cfe22 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:36.046303 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ba02443-1480-4c65-b51f-518a783cfe22 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:36.046754 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ba02443-1480-4c65-b51f-518a783cfe22 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:36.047518 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ba02443-1480-4c65-b51f-518a783cfe22 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:36.047952 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-9ba02443-1480-4c65-b51f-518a783cfe22 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:36.179105 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-9ba02443-1480-4c65-b51f-518a783cfe22 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:36.187124 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-9ba02443-1480-4c65-b51f-518a783cfe22 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1314 microversion: 2.1 time: 0.152503 Aug 02 09:07:36.187681 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 495/990] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:36 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:37.207489 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4dcfce3f-6bbe-4194-8bb6-74207be73f82 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:37.208104 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4dcfce3f-6bbe-4194-8bb6-74207be73f82 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:37.214754 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4dcfce3f-6bbe-4194-8bb6-74207be73f82 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:37.215205 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4dcfce3f-6bbe-4194-8bb6-74207be73f82 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:37.215971 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4dcfce3f-6bbe-4194-8bb6-74207be73f82 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:37.216449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4dcfce3f-6bbe-4194-8bb6-74207be73f82 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:37.344984 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4dcfce3f-6bbe-4194-8bb6-74207be73f82 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:37.352312 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4dcfce3f-6bbe-4194-8bb6-74207be73f82 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1314 microversion: 2.1 time: 0.148717 Aug 02 09:07:37.352855 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 496/991] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:37 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:38.373558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-996ea7c6-3ae9-47c3-9378-9c04c2073633 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:38.374107 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-996ea7c6-3ae9-47c3-9378-9c04c2073633 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:38.380583 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-996ea7c6-3ae9-47c3-9378-9c04c2073633 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:38.381034 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-996ea7c6-3ae9-47c3-9378-9c04c2073633 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:38.381798 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-996ea7c6-3ae9-47c3-9378-9c04c2073633 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:38.382239 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-996ea7c6-3ae9-47c3-9378-9c04c2073633 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:38.509872 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-996ea7c6-3ae9-47c3-9378-9c04c2073633 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:38.517279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-996ea7c6-3ae9-47c3-9378-9c04c2073633 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1314 microversion: 2.1 time: 0.148282 Aug 02 09:07:38.517842 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 496/992] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:38 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:39.538413 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-037060ec-e3c8-4242-b46c-f920d37c0826 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:39.539033 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-037060ec-e3c8-4242-b46c-f920d37c0826 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:39.546009 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-037060ec-e3c8-4242-b46c-f920d37c0826 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:39.546460 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-037060ec-e3c8-4242-b46c-f920d37c0826 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:39.547238 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-037060ec-e3c8-4242-b46c-f920d37c0826 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:39.547678 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-037060ec-e3c8-4242-b46c-f920d37c0826 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:39.568734 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-de7833a7-28a1-443c-8e4c-3211431e9b5b req-24944dce-398b-4914-8eb3-1ae87bbee084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8234b-52c9-42e4-8399-c7af16be35a0", "name": "network-vif-plugged", "status": "completed", "tag": "0fb4a18d-991a-4db0-8ce7-e7f502d6532f"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:39.581199 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-de7833a7-28a1-443c-8e4c-3211431e9b5b req-24944dce-398b-4914-8eb3-1ae87bbee084 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:39.582059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-de7833a7-28a1-443c-8e4c-3211431e9b5b req-24944dce-398b-4914-8eb3-1ae87bbee084 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:39.596912 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-de7833a7-28a1-443c-8e4c-3211431e9b5b req-24944dce-398b-4914-8eb3-1ae87bbee084 service nova] Creating event network-vif-plugged:0fb4a18d-991a-4db0-8ce7-e7f502d6532f for instance f3b8234b-52c9-42e4-8399-c7af16be35a0 on hv-cinder-78729 Aug 02 09:07:39.602791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-de7833a7-28a1-443c-8e4c-3211431e9b5b req-24944dce-398b-4914-8eb3-1ae87bbee084 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037943 Aug 02 09:07:39.604077 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 497/993] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:07:39.680796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-037060ec-e3c8-4242-b46c-f920d37c0826 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:39.688200 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-037060ec-e3c8-4242-b46c-f920d37c0826 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1314 microversion: 2.1 time: 0.153763 Aug 02 09:07:39.688760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 497/994] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:39 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:40.710581 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3f80dea2-351b-41c7-bf42-5b48896ff2eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:40.711202 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3f80dea2-351b-41c7-bf42-5b48896ff2eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:40.713904 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:40.719893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f80dea2-351b-41c7-bf42-5b48896ff2eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:40.720374 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f80dea2-351b-41c7-bf42-5b48896ff2eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:40.721206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f80dea2-351b-41c7-bf42-5b48896ff2eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:40.721647 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f80dea2-351b-41c7-bf42-5b48896ff2eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:40.856852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3f80dea2-351b-41c7-bf42-5b48896ff2eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:40.864245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3f80dea2-351b-41c7-bf42-5b48896ff2eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1314 microversion: 2.1 time: 0.158051 Aug 02 09:07:40.864805 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 498/995] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:40 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:41.886172 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fe505953-d5d3-43db-a4a8-7403475dd9df tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:41.886780 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fe505953-d5d3-43db-a4a8-7403475dd9df tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:41.888633 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:41.889298 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=6 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:41.896129 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fe505953-d5d3-43db-a4a8-7403475dd9df tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:41.896582 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fe505953-d5d3-43db-a4a8-7403475dd9df tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:41.897375 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fe505953-d5d3-43db-a4a8-7403475dd9df tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:41.897835 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fe505953-d5d3-43db-a4a8-7403475dd9df tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:42.030043 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fe505953-d5d3-43db-a4a8-7403475dd9df tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:42.037820 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fe505953-d5d3-43db-a4a8-7403475dd9df tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1498 microversion: 2.1 time: 0.156170 Aug 02 09:07:42.038387 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 498/996] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:41 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:42.641811 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-78da3981-bd9f-4260-b3ad-f7b1117505c3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:42.642296 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-78da3981-bd9f-4260-b3ad-f7b1117505c3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:42.648854 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78da3981-bd9f-4260-b3ad-f7b1117505c3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:42.649302 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78da3981-bd9f-4260-b3ad-f7b1117505c3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:42.650067 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78da3981-bd9f-4260-b3ad-f7b1117505c3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:42.650508 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-78da3981-bd9f-4260-b3ad-f7b1117505c3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:42.675141 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-78da3981-bd9f-4260-b3ad-f7b1117505c3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:07:42.747458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-78da3981-bd9f-4260-b3ad-f7b1117505c3 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 204 len: 0 microversion: 2.1 time: 0.109192 Aug 02 09:07:42.748254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 499/997] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:07:42 2022] DELETE /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:07:42.756733 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-7d263c1a-645d-477d-b386-6b2229eb21eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:42.757344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-7d263c1a-645d-477d-b386-6b2229eb21eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:42.763591 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7d263c1a-645d-477d-b386-6b2229eb21eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:42.764046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7d263c1a-645d-477d-b386-6b2229eb21eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:42.764865 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7d263c1a-645d-477d-b386-6b2229eb21eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:42.765337 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-7d263c1a-645d-477d-b386-6b2229eb21eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:43.145950 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-7d263c1a-645d-477d-b386-6b2229eb21eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:43.153885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-7d263c1a-645d-477d-b386-6b2229eb21eb tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1504 microversion: 2.1 time: 0.401426 Aug 02 09:07:43.154452 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 499/998] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:42 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:44.176059 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-41628701-0c5c-4da3-9640-2168a6d07f5e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:44.176781 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-41628701-0c5c-4da3-9640-2168a6d07f5e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:44.183517 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-41628701-0c5c-4da3-9640-2168a6d07f5e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:44.183962 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-41628701-0c5c-4da3-9640-2168a6d07f5e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:44.184764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-41628701-0c5c-4da3-9640-2168a6d07f5e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:44.185204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-41628701-0c5c-4da3-9640-2168a6d07f5e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:44.315205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-41628701-0c5c-4da3-9640-2168a6d07f5e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:44.323544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-41628701-0c5c-4da3-9640-2168a6d07f5e tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1504 microversion: 2.1 time: 0.151670 Aug 02 09:07:44.324132 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 500/999] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:44 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:45.337135 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-9fec2e02-ad06-4f21-9cab-a81605d369d7 req-09f8f403-01d7-4846-90d8-042f7a2d6613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8234b-52c9-42e4-8399-c7af16be35a0", "name": "network-vif-deleted", "tag": "0fb4a18d-991a-4db0-8ce7-e7f502d6532f"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:45.345051 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-967e967f-9522-4890-b7f3-1cb838fe52a0 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:45.345670 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-967e967f-9522-4890-b7f3-1cb838fe52a0 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:45.348155 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-9fec2e02-ad06-4f21-9cab-a81605d369d7 req-09f8f403-01d7-4846-90d8-042f7a2d6613 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:45.348624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-9fec2e02-ad06-4f21-9cab-a81605d369d7 req-09f8f403-01d7-4846-90d8-042f7a2d6613 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:45.352643 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-967e967f-9522-4890-b7f3-1cb838fe52a0 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:45.353095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-967e967f-9522-4890-b7f3-1cb838fe52a0 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:45.354476 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-967e967f-9522-4890-b7f3-1cb838fe52a0 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:45.354915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-967e967f-9522-4890-b7f3-1cb838fe52a0 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:45.361351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-9fec2e02-ad06-4f21-9cab-a81605d369d7 req-09f8f403-01d7-4846-90d8-042f7a2d6613 service nova] Creating event network-vif-deleted:0fb4a18d-991a-4db0-8ce7-e7f502d6532f for instance f3b8234b-52c9-42e4-8399-c7af16be35a0 on hv-cinder-78729 Aug 02 09:07:45.366343 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-9fec2e02-ad06-4f21-9cab-a81605d369d7 req-09f8f403-01d7-4846-90d8-042f7a2d6613 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Aug 02 09:07:45.367156 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 500/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:45.425564 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-967e967f-9522-4890-b7f3-1cb838fe52a0 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d34b23e862400bbf082a0578708a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cf9558cd344c639e5f1a2051364659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:45.433319 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-967e967f-9522-4890-b7f3-1cb838fe52a0 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 200 len: 1462 microversion: 2.1 time: 0.092134 Aug 02 09:07:45.433918 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 501/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:45 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:46.455763 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:46.456500 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] [instance: f3b8234b-52c9-42e4-8399-c7af16be35a0] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:46.462718 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:46.463170 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:46.463972 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:46.464441 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:46.477482 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] HTTP exception thrown: Instance f3b8234b-52c9-42e4-8399-c7af16be35a0 could not be found. Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Request method failure captured: Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 HTTP/1.1 Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6Ok9UQXpEZ3vAOT1XLtkeNMjSyh0CLEPa2wPeLmP-9c0XXPmlbvNLl6d6JXTKKZTa6gkLCxEnd_vc72_ocOko19MUv7s99J0V-lj4FwGjfwB9WIOZCHsUR7WmtpCD6OPQQWy4NveIy3PuPMzEg7yZjKj1GvCSh3DPWQDLzivqhE-fNk Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 79cf9558cd344c639e5f1a2051364659 Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-VolumesActionsTest-1231312339 Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:07:46.479624 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_79cf9558cd344c639e5f1a2051364659", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/79cf9558cd344c639e5f1a2051364659"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/79cf9558cd344c639e5f1a2051364659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/79cf9558cd344c639e5f1a2051364659"}]}] Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-VolumesActionsTest-1231312339 Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 79cf9558cd344c639e5f1a2051364659 Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-VolumesActionsTest-1231312339 Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-VolumesActionsTest-1231312339-project Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: a7d34b23e862400bbf082a0578708a4b Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-VolumesActionsTest-1231312339-project Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance f3b8234b-52c9-42e4-8399-c7af16be35a0 could not be found. Aug 02 09:07:46.481126 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': 'f3b8234b-52c9-42e4-8399-c7af16be35a0'} Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b8234b-52c9-42e4-8399-c7af16be35a0 could not be found. Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:07:46.482068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b8234b-52c9-42e4-8399-c7af16be35a0 could not be found. Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b8234b-52c9-42e4-8399-c7af16be35a0 could not be found. Aug 02 09:07:46.483689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:07:46.485140 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] Returning 404 to user: Instance f3b8234b-52c9-42e4-8399-c7af16be35a0 could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:07:46.485140 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-09aa807e-4f7f-4822-93f6-c3639ce4ce68 tempest-VolumesActionsTest-1231312339 tempest-VolumesActionsTest-1231312339-project] 10.222.0.17 "GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0" status: 404 len: 111 microversion: 2.1 time: 0.030077 Aug 02 09:07:46.485140 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 501/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:46 2022] GET /compute/v2.1/servers/f3b8234b-52c9-42e4-8399-c7af16be35a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:08:39.686665 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:08:39.687893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 09:08:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:08:50.555758 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:50.557030 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:50.561523 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-74bc06c5-61e0-45d4-a83b-5c9cbfb45fee tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:08:50.563821 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-74bc06c5-61e0-45d4-a83b-5c9cbfb45fee tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:50.573998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-74bc06c5-61e0-45d4-a83b-5c9cbfb45fee tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.574413 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-74bc06c5-61e0-45d4-a83b-5c9cbfb45fee tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.575183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-74bc06c5-61e0-45d4-a83b-5c9cbfb45fee tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.575615 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-74bc06c5-61e0-45d4-a83b-5c9cbfb45fee tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.664358 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-74bc06c5-61e0-45d4-a83b-5c9cbfb45fee tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "POST /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/action" status: 202 len: 0 microversion: 2.1 time: 0.110671 Aug 02 09:08:50.664930 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 502/1003] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 09:08:50 2022] POST /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:08:50.678137 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-0054856d-e30f-4119-b58d-6f0489f1de6e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:50.679078 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-0054856d-e30f-4119-b58d-6f0489f1de6e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:50.681605 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=13 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:50.682904 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=43 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:50.699312 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0054856d-e30f-4119-b58d-6f0489f1de6e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.699768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0054856d-e30f-4119-b58d-6f0489f1de6e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.701008 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0054856d-e30f-4119-b58d-6f0489f1de6e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.701432 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-0054856d-e30f-4119-b58d-6f0489f1de6e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.107759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-0054856d-e30f-4119-b58d-6f0489f1de6e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:51.118092 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-0054856d-e30f-4119-b58d-6f0489f1de6e tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1747 microversion: 2.1 time: 0.447103 Aug 02 09:08:51.118734 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 502/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:50 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1747 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:51.259396 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-89f12c37-2a75-4f62-a2db-b85bc83b1978 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:51.260054 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-89f12c37-2a75-4f62-a2db-b85bc83b1978 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:51.266582 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-89f12c37-2a75-4f62-a2db-b85bc83b1978 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.267119 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-89f12c37-2a75-4f62-a2db-b85bc83b1978 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.267898 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-89f12c37-2a75-4f62-a2db-b85bc83b1978 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.268383 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-89f12c37-2a75-4f62-a2db-b85bc83b1978 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.299996 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-89f12c37-2a75-4f62-a2db-b85bc83b1978 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:08:51.394671 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-89f12c37-2a75-4f62-a2db-b85bc83b1978 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 204 len: 0 microversion: 2.1 time: 0.139955 Aug 02 09:08:51.395254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 503/1005] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:08:51 2022] DELETE /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:08:51.404745 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-33d58cf1-3557-4815-a52b-3993bdd18497 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:51.405521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-33d58cf1-3557-4815-a52b-3993bdd18497 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:51.413323 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-33d58cf1-3557-4815-a52b-3993bdd18497 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.413761 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-33d58cf1-3557-4815-a52b-3993bdd18497 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.414558 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-33d58cf1-3557-4815-a52b-3993bdd18497 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.414999 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-33d58cf1-3557-4815-a52b-3993bdd18497 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.584191 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-33d58cf1-3557-4815-a52b-3993bdd18497 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:51.592487 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-33d58cf1-3557-4815-a52b-3993bdd18497 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1579 microversion: 2.1 time: 0.191856 Aug 02 09:08:51.593689 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 503/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:51 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:52.147989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-3f49b4e4-6839-49ad-b84a-a7b1b07c3d7d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:52.149150 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-3f49b4e4-6839-49ad-b84a-a7b1b07c3d7d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:52.160245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f49b4e4-6839-49ad-b84a-a7b1b07c3d7d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.160976 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f49b4e4-6839-49ad-b84a-a7b1b07c3d7d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.161983 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f49b4e4-6839-49ad-b84a-a7b1b07c3d7d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.162433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-3f49b4e4-6839-49ad-b84a-a7b1b07c3d7d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.411145 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-3f49b4e4-6839-49ad-b84a-a7b1b07c3d7d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:52.423787 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-3f49b4e4-6839-49ad-b84a-a7b1b07c3d7d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1747 microversion: 2.1 time: 0.283509 Aug 02 09:08:52.424775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 504/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:52 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1747 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:52.615620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f4c926d3-d161-4d55-9def-013fc1d14865 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:52.616675 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f4c926d3-d161-4d55-9def-013fc1d14865 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:52.623834 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f4c926d3-d161-4d55-9def-013fc1d14865 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.624869 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f4c926d3-d161-4d55-9def-013fc1d14865 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.625589 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f4c926d3-d161-4d55-9def-013fc1d14865 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.626031 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f4c926d3-d161-4d55-9def-013fc1d14865 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.787456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f4c926d3-d161-4d55-9def-013fc1d14865 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:52.796179 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f4c926d3-d161-4d55-9def-013fc1d14865 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1579 microversion: 2.1 time: 0.184716 Aug 02 09:08:52.796902 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 504/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:52 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1579 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:53.447392 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8bbbe8e8-e2b7-4d5e-a765-d0de800466e7 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:53.448026 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8bbbe8e8-e2b7-4d5e-a765-d0de800466e7 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:53.456475 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8e8-e2b7-4d5e-a765-d0de800466e7 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:53.456921 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8e8-e2b7-4d5e-a765-d0de800466e7 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:53.457710 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8e8-e2b7-4d5e-a765-d0de800466e7 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:53.458142 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8e8-e2b7-4d5e-a765-d0de800466e7 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:53.647631 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8bbbe8e8-e2b7-4d5e-a765-d0de800466e7 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:53.665401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8bbbe8e8-e2b7-4d5e-a765-d0de800466e7 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1747 microversion: 2.1 time: 0.222904 Aug 02 09:08:53.666603 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 505/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:53 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1747 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:53.827749 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-96583dd8-d43f-437a-9ea7-e5c191f66b9d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:53.830965 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-96583dd8-d43f-437a-9ea7-e5c191f66b9d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:53.847953 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-96583dd8-d43f-437a-9ea7-e5c191f66b9d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:53.848721 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-96583dd8-d43f-437a-9ea7-e5c191f66b9d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:53.850100 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-96583dd8-d43f-437a-9ea7-e5c191f66b9d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:53.850877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-96583dd8-d43f-437a-9ea7-e5c191f66b9d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.021031 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-96583dd8-d43f-437a-9ea7-e5c191f66b9d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:54.033007 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-96583dd8-d43f-437a-9ea7-e5c191f66b9d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1579 microversion: 2.1 time: 0.217359 Aug 02 09:08:54.034010 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 505/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:53 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1579 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:54.699621 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-798eb829-285c-4d7e-b4d6-0d476b7f37b8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.701422 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-798eb829-285c-4d7e-b4d6-0d476b7f37b8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:54.712195 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-798eb829-285c-4d7e-b4d6-0d476b7f37b8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.712639 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-798eb829-285c-4d7e-b4d6-0d476b7f37b8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.713638 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-798eb829-285c-4d7e-b4d6-0d476b7f37b8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.714229 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-798eb829-285c-4d7e-b4d6-0d476b7f37b8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:55.012107 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-798eb829-285c-4d7e-b4d6-0d476b7f37b8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:55.027762 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-798eb829-285c-4d7e-b4d6-0d476b7f37b8 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1747 microversion: 2.1 time: 0.332389 Aug 02 09:08:55.029968 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 506/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:54 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1747 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:55.064820 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-1cb917c4-8bd2-4434-9b27-b38fe6232dee tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:55.064820 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-1cb917c4-8bd2-4434-9b27-b38fe6232dee tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:55.072986 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1cb917c4-8bd2-4434-9b27-b38fe6232dee tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:55.073841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1cb917c4-8bd2-4434-9b27-b38fe6232dee tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:55.074896 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1cb917c4-8bd2-4434-9b27-b38fe6232dee tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:55.075600 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-1cb917c4-8bd2-4434-9b27-b38fe6232dee tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:55.253528 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-1cb917c4-8bd2-4434-9b27-b38fe6232dee tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:55.265651 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-1cb917c4-8bd2-4434-9b27-b38fe6232dee tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1579 microversion: 2.1 time: 0.206336 Aug 02 09:08:55.266693 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 506/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:55 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1579 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:55.722548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-61f80719-06c3-4812-a5eb-066f48cbd98b req-e8e21e5c-03e9-41e3-b5b6-f9a460e90bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8145a1-e135-4e3f-90c3-ce4959c7b4df", "name": "network-vif-deleted", "tag": "5a473d55-3a7a-498a-b2b0-5a0bb520a97e"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:08:55.743289 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-61f80719-06c3-4812-a5eb-066f48cbd98b req-e8e21e5c-03e9-41e3-b5b6-f9a460e90bb0 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:55.743956 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-61f80719-06c3-4812-a5eb-066f48cbd98b req-e8e21e5c-03e9-41e3-b5b6-f9a460e90bb0 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:55.774622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-61f80719-06c3-4812-a5eb-066f48cbd98b req-e8e21e5c-03e9-41e3-b5b6-f9a460e90bb0 service nova] Creating event network-vif-deleted:5a473d55-3a7a-498a-b2b0-5a0bb520a97e for instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df on hv-cinder-78729 Aug 02 09:08:55.782351 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-61f80719-06c3-4812-a5eb-066f48cbd98b req-e8e21e5c-03e9-41e3-b5b6-f9a460e90bb0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066665 Aug 02 09:08:55.783135 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 507/1013] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:56.059216 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-3ca5ad9b-395f-40b4-8a1d-799a407fa8f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:56.059833 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-3ca5ad9b-395f-40b4-8a1d-799a407fa8f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:56.067966 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3ca5ad9b-395f-40b4-8a1d-799a407fa8f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:56.068767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3ca5ad9b-395f-40b4-8a1d-799a407fa8f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:56.069465 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3ca5ad9b-395f-40b4-8a1d-799a407fa8f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:56.069948 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-3ca5ad9b-395f-40b4-8a1d-799a407fa8f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:56.269936 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-3ca5ad9b-395f-40b4-8a1d-799a407fa8f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:56.288244 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-3ca5ad9b-395f-40b4-8a1d-799a407fa8f5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.233248 Aug 02 09:08:56.289585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 507/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:56 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:56.302204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-047ccb22-4e81-4254-9838-c545c14dd57c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:56.303211 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-047ccb22-4e81-4254-9838-c545c14dd57c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:56.315384 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-047ccb22-4e81-4254-9838-c545c14dd57c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:56.316249 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-047ccb22-4e81-4254-9838-c545c14dd57c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:56.317472 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-047ccb22-4e81-4254-9838-c545c14dd57c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:56.318083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-047ccb22-4e81-4254-9838-c545c14dd57c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:56.418561 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-047ccb22-4e81-4254-9838-c545c14dd57c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:56.433445 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-047ccb22-4e81-4254-9838-c545c14dd57c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 200 len: 1226 microversion: 2.1 time: 0.137916 Aug 02 09:08:56.434597 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 508/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:56 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:57.312047 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d1d92b12-23f1-43c7-ad25-6af23e9c48be tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:57.313110 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d1d92b12-23f1-43c7-ad25-6af23e9c48be tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:57.320167 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1d92b12-23f1-43c7-ad25-6af23e9c48be tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:57.320638 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1d92b12-23f1-43c7-ad25-6af23e9c48be tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:57.321674 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1d92b12-23f1-43c7-ad25-6af23e9c48be tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:57.322115 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d1d92b12-23f1-43c7-ad25-6af23e9c48be tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:57.464947 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:57.466206 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:57.479180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:57.480338 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:57.481935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:57.482868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:57.511485 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] HTTP exception thrown: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Request method failure captured: Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df HTTP/1.1 Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6Oixkn59yr6wuXjkaaHtGxT_e5zjiNZVXI_m27dasm09ki80E9lbJDqu5Cr4uIW3ayGc_rQppvMbme9MBfBkPVJcO-8id5y03HmpL4ze0oyU62KTH1Sk8wU--J_zSCzjwViMLY9loO552178rhHs9vG4Volq2bs8sqrYUP9wg7Rs2dQ Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:08:57.514663 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b7960c66a61441faa18ef4ba42f5e5e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}] Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e469194b140942bf929001c7e12a0933 Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:08:57.519429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '0d8145a1-e135-4e3f-90c3-ce4959c7b4df'} Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:08:57.520840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:08:57.522998 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:08:57.525315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Returning 404 to user: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:08:57.525429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d1d92b12-23f1-43c7-ad25-6af23e9c48be tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:57.525554 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-12a780ae-2973-4576-a356-27793692ba48 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 404 len: 111 microversion: 2.1 time: 0.056520 Aug 02 09:08:57.525554 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 509/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:57 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:08:57.538716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d1d92b12-23f1-43c7-ad25-6af23e9c48be tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.231156 Aug 02 09:08:57.539896 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 508/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:57 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:57.665219 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1772329190", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2022130069", "security_groups": [{"name": "tempest-secgroup-smoke-1261723041"}], "block_device_mapping_v2": [{"uuid": "889d5074-83a7-467c-850f-74b206fbedd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e340dc33-11ff-4604-ba77-133c90e12728"}]}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:08:57.828558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] validate_networks() for [('e340dc33-11ff-4604-ba77-133c90e12728', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:08:58.312705 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:08:58.313425 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:08:58.314156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:08:58.314800 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:08:58.315548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:08:58.330502 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:58.331240 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:58.332467 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:58.333109 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:58.359739 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Getting quotas for project 4b7960c66a61441faa18ef4ba42f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:08:58.365173 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Getting quotas for user e469194b140942bf929001c7e12a0933 and project 4b7960c66a61441faa18ef4ba42f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:08:58.457235 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:08:58.459409 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='889d5074-83a7-467c-850f-74b206fbedd3',volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:08:58.566291 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-28a0cdaa-e770-42e2-85ae-1d5977c3229a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:58.567139 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-28a0cdaa-e770-42e2-85ae-1d5977c3229a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:58.574226 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-28a0cdaa-e770-42e2-85ae-1d5977c3229a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:58.574676 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-28a0cdaa-e770-42e2-85ae-1d5977c3229a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:58.575456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-28a0cdaa-e770-42e2-85ae-1d5977c3229a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:58.575885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-28a0cdaa-e770-42e2-85ae-1d5977c3229a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:58.638899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8a0bf847-d917-48bd-b3e5-6005a449ef03 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.979303 Aug 02 09:08:58.640628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 510/1018] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:08:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:08:58.655052 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-627007a6-cb20-4203-bdce-525f8afc3c39 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:58.655567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-627007a6-cb20-4203-bdce-525f8afc3c39 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:58.747261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-627007a6-cb20-4203-bdce-525f8afc3c39 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:58.755091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-627007a6-cb20-4203-bdce-525f8afc3c39 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1095 microversion: 2.1 time: 0.105368 Aug 02 09:08:58.769313 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 511/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:58 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1095 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:58.790252 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-28a0cdaa-e770-42e2-85ae-1d5977c3229a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:58.818680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-28a0cdaa-e770-42e2-85ae-1d5977c3229a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.256735 Aug 02 09:08:58.819655 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 509/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:58 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:59.782783 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c475e517-a9c2-4fb4-b21a-e4c921cc4d52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:59.783929 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c475e517-a9c2-4fb4-b21a-e4c921cc4d52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:59.791957 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c475e517-a9c2-4fb4-b21a-e4c921cc4d52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:59.793126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c475e517-a9c2-4fb4-b21a-e4c921cc4d52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:59.793338 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c475e517-a9c2-4fb4-b21a-e4c921cc4d52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:59.793721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c475e517-a9c2-4fb4-b21a-e4c921cc4d52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:59.845730 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-211ef80f-2a03-4187-97d8-05f27963a70a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:59.850662 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-211ef80f-2a03-4187-97d8-05f27963a70a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:59.865543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-211ef80f-2a03-4187-97d8-05f27963a70a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:59.866245 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-211ef80f-2a03-4187-97d8-05f27963a70a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:59.867460 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-211ef80f-2a03-4187-97d8-05f27963a70a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:59.868082 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-211ef80f-2a03-4187-97d8-05f27963a70a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:59.872820 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c475e517-a9c2-4fb4-b21a-e4c921cc4d52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:59.887858 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c475e517-a9c2-4fb4-b21a-e4c921cc4d52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1193 microversion: 2.1 time: 0.112922 Aug 02 09:08:59.890259 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 512/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:59 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1193 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:00.105760 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-211ef80f-2a03-4187-97d8-05f27963a70a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:00.120040 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-211ef80f-2a03-4187-97d8-05f27963a70a tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.279935 Aug 02 09:09:00.121633 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 510/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:59 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:00.911569 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f1e34e5a-71da-48f5-b3fe-3b452cc5fc1c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:00.912110 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f1e34e5a-71da-48f5-b3fe-3b452cc5fc1c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:00.923493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f1e34e5a-71da-48f5-b3fe-3b452cc5fc1c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:00.924654 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f1e34e5a-71da-48f5-b3fe-3b452cc5fc1c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:00.925804 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f1e34e5a-71da-48f5-b3fe-3b452cc5fc1c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:00.926345 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f1e34e5a-71da-48f5-b3fe-3b452cc5fc1c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:01.042440 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f1e34e5a-71da-48f5-b3fe-3b452cc5fc1c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:01.056519 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f1e34e5a-71da-48f5-b3fe-3b452cc5fc1c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1211 microversion: 2.1 time: 0.148831 Aug 02 09:09:01.057361 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 513/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:00 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1211 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:01.144949 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b49238b6-c2f2-4202-928a-658f3f0f3a8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:01.145738 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b49238b6-c2f2-4202-928a-658f3f0f3a8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:01.153727 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b49238b6-c2f2-4202-928a-658f3f0f3a8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:01.154282 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b49238b6-c2f2-4202-928a-658f3f0f3a8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:01.155773 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b49238b6-c2f2-4202-928a-658f3f0f3a8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:01.156492 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b49238b6-c2f2-4202-928a-658f3f0f3a8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:01.383761 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b49238b6-c2f2-4202-928a-658f3f0f3a8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:01.398896 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b49238b6-c2f2-4202-928a-658f3f0f3a8f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.259798 Aug 02 09:09:01.400524 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 511/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:01 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:02.080346 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7edb3862-e50f-4269-80cb-6b5c7344f5c2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:02.081126 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7edb3862-e50f-4269-80cb-6b5c7344f5c2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:02.091827 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7edb3862-e50f-4269-80cb-6b5c7344f5c2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.092636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7edb3862-e50f-4269-80cb-6b5c7344f5c2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:02.094489 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7edb3862-e50f-4269-80cb-6b5c7344f5c2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.095244 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7edb3862-e50f-4269-80cb-6b5c7344f5c2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:02.121608 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-04aefa7d-1b83-4eb8-8bb1-30254a365fe1 req-30ed85f6-0c0d-4c2e-958b-a66fdad090f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28da5cb-5993-4f00-8eb8-e92df2b91327", "tag": "93c10580-c667-40a2-b8f1-70aaf1f3ed5b"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:02.132536 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-04aefa7d-1b83-4eb8-8bb1-30254a365fe1 req-30ed85f6-0c0d-4c2e-958b-a66fdad090f8 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.132978 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-04aefa7d-1b83-4eb8-8bb1-30254a365fe1 req-30ed85f6-0c0d-4c2e-958b-a66fdad090f8 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:02.148597 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-04aefa7d-1b83-4eb8-8bb1-30254a365fe1 req-30ed85f6-0c0d-4c2e-958b-a66fdad090f8 service nova] Creating event network-changed:93c10580-c667-40a2-b8f1-70aaf1f3ed5b for instance e28da5cb-5993-4f00-8eb8-e92df2b91327 on hv-cinder-78729 Aug 02 09:09:02.154340 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-04aefa7d-1b83-4eb8-8bb1-30254a365fe1 req-30ed85f6-0c0d-4c2e-958b-a66fdad090f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040935 Aug 02 09:09:02.154951 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 512/1025] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:02.342926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7edb3862-e50f-4269-80cb-6b5c7344f5c2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:02.352448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7edb3862-e50f-4269-80cb-6b5c7344f5c2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.277316 Aug 02 09:09:02.364330 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 514/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:02 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:02.435875 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-821ba14f-0a05-417f-8d4a-29194117a54c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:02.438733 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-821ba14f-0a05-417f-8d4a-29194117a54c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:02.450197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-821ba14f-0a05-417f-8d4a-29194117a54c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.451021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-821ba14f-0a05-417f-8d4a-29194117a54c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:02.453020 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-821ba14f-0a05-417f-8d4a-29194117a54c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.453838 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-821ba14f-0a05-417f-8d4a-29194117a54c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:02.664405 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-821ba14f-0a05-417f-8d4a-29194117a54c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:02.673494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-821ba14f-0a05-417f-8d4a-29194117a54c tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.245696 Aug 02 09:09:02.674092 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 513/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:02 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:03.383218 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2d561c2b-be12-42f8-9eae-826281bfa6bf tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:03.383928 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2d561c2b-be12-42f8-9eae-826281bfa6bf tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:03.396634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2d561c2b-be12-42f8-9eae-826281bfa6bf tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:03.396634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2d561c2b-be12-42f8-9eae-826281bfa6bf tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:03.396634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2d561c2b-be12-42f8-9eae-826281bfa6bf tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:03.396634 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2d561c2b-be12-42f8-9eae-826281bfa6bf tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:03.537708 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2d561c2b-be12-42f8-9eae-826281bfa6bf tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:03.546067 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2d561c2b-be12-42f8-9eae-826281bfa6bf tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.166765 Aug 02 09:09:03.546645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 515/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:03 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:03.697137 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5c3318e1-06ed-4f54-8cf8-477f8ef3915d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:03.697786 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5c3318e1-06ed-4f54-8cf8-477f8ef3915d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:03.707197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5c3318e1-06ed-4f54-8cf8-477f8ef3915d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:03.707636 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5c3318e1-06ed-4f54-8cf8-477f8ef3915d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:03.708571 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5c3318e1-06ed-4f54-8cf8-477f8ef3915d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:03.709004 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5c3318e1-06ed-4f54-8cf8-477f8ef3915d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:03.877714 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5c3318e1-06ed-4f54-8cf8-477f8ef3915d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:03.894160 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5c3318e1-06ed-4f54-8cf8-477f8ef3915d tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.201121 Aug 02 09:09:03.894751 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 514/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:03 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:04.566921 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-a45d0a14-507b-498b-91e2-d26ab84bf57e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:04.567537 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-a45d0a14-507b-498b-91e2-d26ab84bf57e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:04.574525 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a45d0a14-507b-498b-91e2-d26ab84bf57e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:04.574977 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a45d0a14-507b-498b-91e2-d26ab84bf57e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:04.575765 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a45d0a14-507b-498b-91e2-d26ab84bf57e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:04.576261 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-a45d0a14-507b-498b-91e2-d26ab84bf57e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:04.718092 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-a45d0a14-507b-498b-91e2-d26ab84bf57e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:04.726115 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-a45d0a14-507b-498b-91e2-d26ab84bf57e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.163070 Aug 02 09:09:04.726686 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 516/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:04 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:04.915935 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c9696373-3a00-4032-b4a5-1e11b21d55e5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:04.916548 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c9696373-3a00-4032-b4a5-1e11b21d55e5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:04.923121 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c9696373-3a00-4032-b4a5-1e11b21d55e5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:04.923575 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c9696373-3a00-4032-b4a5-1e11b21d55e5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:04.924385 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c9696373-3a00-4032-b4a5-1e11b21d55e5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:04.924830 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c9696373-3a00-4032-b4a5-1e11b21d55e5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:05.074071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c9696373-3a00-4032-b4a5-1e11b21d55e5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:05.084315 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c9696373-3a00-4032-b4a5-1e11b21d55e5 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.172437 Aug 02 09:09:05.085016 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 515/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:04 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:05.747724 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-90594e6d-b9a6-4161-8ffb-2493f86c6d05 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:05.748270 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-90594e6d-b9a6-4161-8ffb-2493f86c6d05 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:05.757205 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-90594e6d-b9a6-4161-8ffb-2493f86c6d05 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:05.757700 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-90594e6d-b9a6-4161-8ffb-2493f86c6d05 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:05.758499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-90594e6d-b9a6-4161-8ffb-2493f86c6d05 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:05.758935 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-90594e6d-b9a6-4161-8ffb-2493f86c6d05 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:05.892027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-90594e6d-b9a6-4161-8ffb-2493f86c6d05 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:05.899585 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-90594e6d-b9a6-4161-8ffb-2493f86c6d05 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.156627 Aug 02 09:09:05.900170 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 517/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:05 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:06.106475 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-16b53aca-09f9-4f09-8718-60e4f9aae0fe tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:06.107088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-16b53aca-09f9-4f09-8718-60e4f9aae0fe tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:06.114847 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-16b53aca-09f9-4f09-8718-60e4f9aae0fe tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:06.115301 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-16b53aca-09f9-4f09-8718-60e4f9aae0fe tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:06.116135 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-16b53aca-09f9-4f09-8718-60e4f9aae0fe tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:06.116601 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-16b53aca-09f9-4f09-8718-60e4f9aae0fe tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:06.276841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-16b53aca-09f9-4f09-8718-60e4f9aae0fe tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:06.286046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-16b53aca-09f9-4f09-8718-60e4f9aae0fe tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1752 microversion: 2.1 time: 0.183598 Aug 02 09:09:06.286863 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 516/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:06 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:06.920480 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0d90a8db-0495-4b9f-a357-42c65b568fa4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:06.921091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0d90a8db-0495-4b9f-a357-42c65b568fa4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:06.927539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d90a8db-0495-4b9f-a357-42c65b568fa4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:06.928067 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d90a8db-0495-4b9f-a357-42c65b568fa4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:06.928781 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d90a8db-0495-4b9f-a357-42c65b568fa4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:06.929256 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d90a8db-0495-4b9f-a357-42c65b568fa4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:07.066254 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0d90a8db-0495-4b9f-a357-42c65b568fa4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:07.069777 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:07.074982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0d90a8db-0495-4b9f-a357-42c65b568fa4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.158383 Aug 02 09:09:07.075544 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 518/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:06 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:07.309209 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e4f974d6-f46c-48f2-ba6f-56858a4eaf40 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:07.310070 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e4f974d6-f46c-48f2-ba6f-56858a4eaf40 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:07.317535 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e4f974d6-f46c-48f2-ba6f-56858a4eaf40 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:07.317921 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e4f974d6-f46c-48f2-ba6f-56858a4eaf40 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:07.318713 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e4f974d6-f46c-48f2-ba6f-56858a4eaf40 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:07.319161 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e4f974d6-f46c-48f2-ba6f-56858a4eaf40 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:07.473759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e4f974d6-f46c-48f2-ba6f-56858a4eaf40 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:07.483679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e4f974d6-f46c-48f2-ba6f-56858a4eaf40 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1755 microversion: 2.1 time: 0.177870 Aug 02 09:09:07.485160 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 517/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:07 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:08.097834 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d45ae7de-28f5-46a6-8a1d-95d0d56605e6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:08.098402 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d45ae7de-28f5-46a6-8a1d-95d0d56605e6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:08.106339 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d45ae7de-28f5-46a6-8a1d-95d0d56605e6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:08.106786 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d45ae7de-28f5-46a6-8a1d-95d0d56605e6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:08.107549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d45ae7de-28f5-46a6-8a1d-95d0d56605e6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:08.107982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d45ae7de-28f5-46a6-8a1d-95d0d56605e6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:08.240363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d45ae7de-28f5-46a6-8a1d-95d0d56605e6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:08.247748 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d45ae7de-28f5-46a6-8a1d-95d0d56605e6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.155244 Aug 02 09:09:08.248342 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 519/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:08 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:09.269728 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b1ae393f-7693-47d6-aeba-e6cd13c11c98 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:09.270299 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b1ae393f-7693-47d6-aeba-e6cd13c11c98 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:09.276466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b1ae393f-7693-47d6-aeba-e6cd13c11c98 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:09.276920 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b1ae393f-7693-47d6-aeba-e6cd13c11c98 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:09.277691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b1ae393f-7693-47d6-aeba-e6cd13c11c98 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:09.278130 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b1ae393f-7693-47d6-aeba-e6cd13c11c98 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:09.414943 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b1ae393f-7693-47d6-aeba-e6cd13c11c98 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:09.422521 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b1ae393f-7693-47d6-aeba-e6cd13c11c98 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.156963 Aug 02 09:09:09.423086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 518/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:09 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:10.443395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-4bee2ecb-5caf-4225-a7ea-8de6ca1fd4c7 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:10.443984 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-4bee2ecb-5caf-4225-a7ea-8de6ca1fd4c7 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:10.445838 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:10.446833 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=8 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:10.455105 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4bee2ecb-5caf-4225-a7ea-8de6ca1fd4c7 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:10.455561 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4bee2ecb-5caf-4225-a7ea-8de6ca1fd4c7 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:10.456389 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4bee2ecb-5caf-4225-a7ea-8de6ca1fd4c7 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:10.456828 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-4bee2ecb-5caf-4225-a7ea-8de6ca1fd4c7 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:10.588883 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-4bee2ecb-5caf-4225-a7ea-8de6ca1fd4c7 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:10.596875 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-4bee2ecb-5caf-4225-a7ea-8de6ca1fd4c7 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.157962 Aug 02 09:09:10.597441 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 520/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:10 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:11.617235 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6580db00-9c8f-4591-8c08-bc848f117110 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:11.619358 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6580db00-9c8f-4591-8c08-bc848f117110 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:11.624928 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6580db00-9c8f-4591-8c08-bc848f117110 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:11.625381 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6580db00-9c8f-4591-8c08-bc848f117110 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:11.626149 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6580db00-9c8f-4591-8c08-bc848f117110 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:11.626613 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6580db00-9c8f-4591-8c08-bc848f117110 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:11.630707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=100 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:11.758871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6580db00-9c8f-4591-8c08-bc848f117110 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:11.766871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6580db00-9c8f-4591-8c08-bc848f117110 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.153406 Aug 02 09:09:11.768098 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 519/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:11 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:12.789158 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-c2705fd6-6b04-4ed7-9ae0-273457fbd8f2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:12.789888 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-c2705fd6-6b04-4ed7-9ae0-273457fbd8f2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:12.796636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c2705fd6-6b04-4ed7-9ae0-273457fbd8f2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:12.797095 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c2705fd6-6b04-4ed7-9ae0-273457fbd8f2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:12.797871 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c2705fd6-6b04-4ed7-9ae0-273457fbd8f2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:12.798307 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-c2705fd6-6b04-4ed7-9ae0-273457fbd8f2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:12.937212 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-c2705fd6-6b04-4ed7-9ae0-273457fbd8f2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:12.945345 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-c2705fd6-6b04-4ed7-9ae0-273457fbd8f2 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.160177 Aug 02 09:09:12.945915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 521/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:12 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:13.966883 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-30c58616-6b97-4f94-96d8-dfb7500bb49e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:13.967502 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-30c58616-6b97-4f94-96d8-dfb7500bb49e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:13.974090 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-30c58616-6b97-4f94-96d8-dfb7500bb49e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:13.974543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-30c58616-6b97-4f94-96d8-dfb7500bb49e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:13.975333 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-30c58616-6b97-4f94-96d8-dfb7500bb49e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:13.975775 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-30c58616-6b97-4f94-96d8-dfb7500bb49e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:14.106831 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-78b4e203-c28a-48d7-82cb-eda6596ee754 req-fa3537a9-b54a-4fba-b432-f021226452d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28da5cb-5993-4f00-8eb8-e92df2b91327", "name": "network-vif-plugged", "status": "completed", "tag": "93c10580-c667-40a2-b8f1-70aaf1f3ed5b"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:14.113759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-30c58616-6b97-4f94-96d8-dfb7500bb49e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:14.121772 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-78b4e203-c28a-48d7-82cb-eda6596ee754 req-fa3537a9-b54a-4fba-b432-f021226452d3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:14.122226 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-78b4e203-c28a-48d7-82cb-eda6596ee754 req-fa3537a9-b54a-4fba-b432-f021226452d3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:14.122651 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-30c58616-6b97-4f94-96d8-dfb7500bb49e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.159530 Aug 02 09:09:14.133868 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-78b4e203-c28a-48d7-82cb-eda6596ee754 req-fa3537a9-b54a-4fba-b432-f021226452d3 service nova] Creating event network-vif-plugged:93c10580-c667-40a2-b8f1-70aaf1f3ed5b for instance e28da5cb-5993-4f00-8eb8-e92df2b91327 on hv-cinder-78729 Aug 02 09:09:14.136485 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 520/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:13 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:14.139066 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-78b4e203-c28a-48d7-82cb-eda6596ee754 req-fa3537a9-b54a-4fba-b432-f021226452d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036709 Aug 02 09:09:14.139887 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 522/1042] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:09:15.143022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fba8a831-cd80-4418-8c7c-ac6e90cc888a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:15.143561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fba8a831-cd80-4418-8c7c-ac6e90cc888a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:15.150086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fba8a831-cd80-4418-8c7c-ac6e90cc888a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:15.150533 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fba8a831-cd80-4418-8c7c-ac6e90cc888a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:15.151296 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fba8a831-cd80-4418-8c7c-ac6e90cc888a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:15.151744 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fba8a831-cd80-4418-8c7c-ac6e90cc888a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:15.287059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-fba8a831-cd80-4418-8c7c-ac6e90cc888a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:15.294483 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fba8a831-cd80-4418-8c7c-ac6e90cc888a tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1267 microversion: 2.1 time: 0.155446 Aug 02 09:09:15.295046 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 521/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:15 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:16.316123 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-03156115-d9dd-4480-9497-2d05ae43d2ea tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:16.316875 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-03156115-d9dd-4480-9497-2d05ae43d2ea tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:16.323961 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03156115-d9dd-4480-9497-2d05ae43d2ea tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:16.324447 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03156115-d9dd-4480-9497-2d05ae43d2ea tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:16.325216 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03156115-d9dd-4480-9497-2d05ae43d2ea tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:16.325656 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-03156115-d9dd-4480-9497-2d05ae43d2ea tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:16.462717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-03156115-d9dd-4480-9497-2d05ae43d2ea tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:16.470225 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-03156115-d9dd-4480-9497-2d05ae43d2ea tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1455 microversion: 2.1 time: 0.158783 Aug 02 09:09:16.470791 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 523/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:16 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:16.490732 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f8b138ea-c7ec-405d-a678-d2409ba21403 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:16.491466 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f8b138ea-c7ec-405d-a678-d2409ba21403 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:16.498030 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f8b138ea-c7ec-405d-a678-d2409ba21403 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:16.498475 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f8b138ea-c7ec-405d-a678-d2409ba21403 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:16.499350 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f8b138ea-c7ec-405d-a678-d2409ba21403 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:16.499679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f8b138ea-c7ec-405d-a678-d2409ba21403 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:16.634152 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f8b138ea-c7ec-405d-a678-d2409ba21403 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:16.641590 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f8b138ea-c7ec-405d-a678-d2409ba21403 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1455 microversion: 2.1 time: 0.155574 Aug 02 09:09:16.642177 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 522/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:16 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:18.226266 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-5e91a42f-8d09-402e-8031-46417367f6d9 req-571e55ae-4e4f-4099-8a8a-cb2d820a23d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28da5cb-5993-4f00-8eb8-e92df2b91327", "tag": "93c10580-c667-40a2-b8f1-70aaf1f3ed5b"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:18.236052 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-5e91a42f-8d09-402e-8031-46417367f6d9 req-571e55ae-4e4f-4099-8a8a-cb2d820a23d0 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:18.236539 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-5e91a42f-8d09-402e-8031-46417367f6d9 req-571e55ae-4e4f-4099-8a8a-cb2d820a23d0 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:18.247499 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-5e91a42f-8d09-402e-8031-46417367f6d9 req-571e55ae-4e4f-4099-8a8a-cb2d820a23d0 service nova] Creating event network-changed:93c10580-c667-40a2-b8f1-70aaf1f3ed5b for instance e28da5cb-5993-4f00-8eb8-e92df2b91327 on hv-cinder-78729 Aug 02 09:09:18.252482 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-5e91a42f-8d09-402e-8031-46417367f6d9 req-571e55ae-4e4f-4099-8a8a-cb2d820a23d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030394 Aug 02 09:09:18.253083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 524/1046] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:09:40.126818 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-573446248", "imageRef": "2a483a1c-f2f7-4657-80cc-2241faf39142", "flavorRef": "452"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:40.133825 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=42 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:40.134492 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=22 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:40.180593 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.network.neutron [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] validate_networks() for None {{(pid=117773) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:09:40.458344 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Flavor limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:09:40.459396 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Image limits 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:09:40.459898 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Flavor pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:09:40.460362 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Image pref 0:0:0 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:09:40.460779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.virt.hardware [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:09:40.470495 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:40.470952 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:40.471755 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:40.472212 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:40.488991 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Getting quotas for project 2ed0a70b5f594643ba70d6b7829e3124. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:09:40.493998 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.quota [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Getting quotas for user 9de6a21ca5074f1598cd417d80c96feb and project 2ed0a70b5f594643ba70d6b7829e3124. Resources: {'ram', 'instances', 'cores'} {{(pid=117773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:09:40.509768 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Going to run 1 instances... {{(pid=117773) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:09:40.512183 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a483a1c-f2f7-4657-80cc-2241faf39142',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:09:40.558040 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f98d321a-7117-4cf7-91d7-92799fe0d01c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435301 Aug 02 09:09:40.558699 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 523/1047] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:09:40.571094 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-b17cbd75-0b5f-4460-a809-d0a5cc48b7f9 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:40.572003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-b17cbd75-0b5f-4460-a809-d0a5cc48b7f9 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:40.574315 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:40.575135 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=28 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:40.630839 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-b17cbd75-0b5f-4460-a809-d0a5cc48b7f9 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:40.637681 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-b17cbd75-0b5f-4460-a809-d0a5cc48b7f9 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1214 microversion: 2.1 time: 0.071899 Aug 02 09:09:40.638288 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 525/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:40 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:41.659991 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-39a2ac65-0077-44b1-9311-3d43712067d5 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:41.660897 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-39a2ac65-0077-44b1-9311-3d43712067d5 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:41.667824 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-39a2ac65-0077-44b1-9311-3d43712067d5 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:41.668392 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-39a2ac65-0077-44b1-9311-3d43712067d5 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:41.669240 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-39a2ac65-0077-44b1-9311-3d43712067d5 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:41.670999 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-39a2ac65-0077-44b1-9311-3d43712067d5 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:41.741445 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-39a2ac65-0077-44b1-9311-3d43712067d5 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:41.749340 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-39a2ac65-0077-44b1-9311-3d43712067d5 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1284 microversion: 2.1 time: 0.094507 Aug 02 09:09:41.749913 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 524/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:41 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:42.772713 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8ffd3dbb-56ff-4dba-b567-308289774b1b tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:42.773604 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8ffd3dbb-56ff-4dba-b567-308289774b1b tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:42.782003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8ffd3dbb-56ff-4dba-b567-308289774b1b tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:42.782461 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8ffd3dbb-56ff-4dba-b567-308289774b1b tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:42.783251 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8ffd3dbb-56ff-4dba-b567-308289774b1b tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:42.783946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-8ffd3dbb-56ff-4dba-b567-308289774b1b tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:42.964589 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8ffd3dbb-56ff-4dba-b567-308289774b1b tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:42.972507 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8ffd3dbb-56ff-4dba-b567-308289774b1b tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1314 microversion: 2.1 time: 0.205308 Aug 02 09:09:42.973369 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 526/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:42 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:43.415490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-2e0a43fb-459d-458c-8dcb-071fce01df4c req-e958496e-9a6d-4252-83d9-0a8369491a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9336b69-035d-47f4-9145-e31d9dea37c1", "tag": "71ab9f51-9fb6-4b56-bf63-900f12c45aa7"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:43.425347 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-2e0a43fb-459d-458c-8dcb-071fce01df4c req-e958496e-9a6d-4252-83d9-0a8369491a96 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:43.425790 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-2e0a43fb-459d-458c-8dcb-071fce01df4c req-e958496e-9a6d-4252-83d9-0a8369491a96 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:43.438234 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-2e0a43fb-459d-458c-8dcb-071fce01df4c req-e958496e-9a6d-4252-83d9-0a8369491a96 service nova] Creating event network-changed:71ab9f51-9fb6-4b56-bf63-900f12c45aa7 for instance e9336b69-035d-47f4-9145-e31d9dea37c1 on hv-cinder-78729 Aug 02 09:09:43.443459 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-2e0a43fb-459d-458c-8dcb-071fce01df4c req-e958496e-9a6d-4252-83d9-0a8369491a96 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167677 Aug 02 09:09:43.444094 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 525/1051] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:43.994554 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-90bcd33b-b08d-486d-8e58-ab509f42c89d tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:43.995166 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-90bcd33b-b08d-486d-8e58-ab509f42c89d tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:44.001707 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-90bcd33b-b08d-486d-8e58-ab509f42c89d tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:44.002156 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-90bcd33b-b08d-486d-8e58-ab509f42c89d tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:44.002925 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-90bcd33b-b08d-486d-8e58-ab509f42c89d tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:44.004909 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-90bcd33b-b08d-486d-8e58-ab509f42c89d tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:44.132466 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-90bcd33b-b08d-486d-8e58-ab509f42c89d tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:44.139780 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-90bcd33b-b08d-486d-8e58-ab509f42c89d tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1314 microversion: 2.1 time: 0.149143 Aug 02 09:09:44.140378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 527/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:43 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:45.162717 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b4345fb8-597e-4839-b230-65ef403e354c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:45.163834 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b4345fb8-597e-4839-b230-65ef403e354c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:45.171737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b4345fb8-597e-4839-b230-65ef403e354c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:45.172224 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b4345fb8-597e-4839-b230-65ef403e354c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:45.173029 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b4345fb8-597e-4839-b230-65ef403e354c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:45.173473 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b4345fb8-597e-4839-b230-65ef403e354c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:45.329142 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-b4345fb8-597e-4839-b230-65ef403e354c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:45.336944 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b4345fb8-597e-4839-b230-65ef403e354c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1314 microversion: 2.1 time: 0.179790 Aug 02 09:09:45.337530 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 526/1053] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:45 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:46.357843 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-07efd4e6-7803-4161-8423-3b28562ec88a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:46.359457 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-07efd4e6-7803-4161-8423-3b28562ec88a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:46.366999 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-07efd4e6-7803-4161-8423-3b28562ec88a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:46.367928 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-07efd4e6-7803-4161-8423-3b28562ec88a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:46.369182 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-07efd4e6-7803-4161-8423-3b28562ec88a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:46.369675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-07efd4e6-7803-4161-8423-3b28562ec88a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:46.592032 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-07efd4e6-7803-4161-8423-3b28562ec88a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:46.599930 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-07efd4e6-7803-4161-8423-3b28562ec88a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1314 microversion: 2.1 time: 0.245816 Aug 02 09:09:46.600860 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 528/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:46 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:47.626075 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-106bfd05-ea56-4040-99f8-9cccb2149bc6 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:47.626680 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-106bfd05-ea56-4040-99f8-9cccb2149bc6 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:47.634089 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-106bfd05-ea56-4040-99f8-9cccb2149bc6 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.634534 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-106bfd05-ea56-4040-99f8-9cccb2149bc6 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.635637 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-106bfd05-ea56-4040-99f8-9cccb2149bc6 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.636078 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-106bfd05-ea56-4040-99f8-9cccb2149bc6 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.772401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-106bfd05-ea56-4040-99f8-9cccb2149bc6 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:47.780064 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-106bfd05-ea56-4040-99f8-9cccb2149bc6 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1314 microversion: 2.1 time: 0.157817 Aug 02 09:09:47.780692 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 527/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:47 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:48.801108 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-da951671-bdad-46e0-b721-57b35af11dfd tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:48.801730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-da951671-bdad-46e0-b721-57b35af11dfd tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:48.808617 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da951671-bdad-46e0-b721-57b35af11dfd tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.809082 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da951671-bdad-46e0-b721-57b35af11dfd tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.809878 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da951671-bdad-46e0-b721-57b35af11dfd tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.810320 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-da951671-bdad-46e0-b721-57b35af11dfd tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.946277 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-da951671-bdad-46e0-b721-57b35af11dfd tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:48.953822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-da951671-bdad-46e0-b721-57b35af11dfd tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1314 microversion: 2.1 time: 0.156627 Aug 02 09:09:48.954406 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 529/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:48 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:49.977990 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c4a9dac8-deda-48c1-8c3c-914baa70f4e1 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:49.978610 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c4a9dac8-deda-48c1-8c3c-914baa70f4e1 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:49.985270 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c4a9dac8-deda-48c1-8c3c-914baa70f4e1 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.985728 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c4a9dac8-deda-48c1-8c3c-914baa70f4e1 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:49.986518 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c4a9dac8-deda-48c1-8c3c-914baa70f4e1 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.986967 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c4a9dac8-deda-48c1-8c3c-914baa70f4e1 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:50.129339 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-c4a9dac8-deda-48c1-8c3c-914baa70f4e1 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:50.136905 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c4a9dac8-deda-48c1-8c3c-914baa70f4e1 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1314 microversion: 2.1 time: 0.163967 Aug 02 09:09:50.137470 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 528/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:49 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:50.308869 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-9a86cf34-e028-4f4d-a6e3-f4d54a30b24f req-a611efb4-36ad-4034-b959-024e1a88cc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9336b69-035d-47f4-9145-e31d9dea37c1", "name": "network-vif-plugged", "status": "completed", "tag": "71ab9f51-9fb6-4b56-bf63-900f12c45aa7"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:50.320571 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-9a86cf34-e028-4f4d-a6e3-f4d54a30b24f req-a611efb4-36ad-4034-b959-024e1a88cc08 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:50.321660 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-9a86cf34-e028-4f4d-a6e3-f4d54a30b24f req-a611efb4-36ad-4034-b959-024e1a88cc08 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:50.333542 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-9a86cf34-e028-4f4d-a6e3-f4d54a30b24f req-a611efb4-36ad-4034-b959-024e1a88cc08 service nova] Creating event network-vif-plugged:71ab9f51-9fb6-4b56-bf63-900f12c45aa7 for instance e9336b69-035d-47f4-9145-e31d9dea37c1 on hv-cinder-78729 Aug 02 09:09:50.338729 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-9a86cf34-e028-4f4d-a6e3-f4d54a30b24f req-a611efb4-36ad-4034-b959-024e1a88cc08 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033654 Aug 02 09:09:50.339641 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 530/1058] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:51.157986 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-12230f38-1a7c-494d-993a-3505d589b32a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:51.158562 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-12230f38-1a7c-494d-993a-3505d589b32a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:51.160487 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=2 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:51.161185 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=6 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:51.167480 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-12230f38-1a7c-494d-993a-3505d589b32a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.167913 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-12230f38-1a7c-494d-993a-3505d589b32a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.168719 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-12230f38-1a7c-494d-993a-3505d589b32a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.169160 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-12230f38-1a7c-494d-993a-3505d589b32a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.301614 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-12230f38-1a7c-494d-993a-3505d589b32a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:51.309717 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-12230f38-1a7c-494d-993a-3505d589b32a tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1314 microversion: 2.1 time: 0.155758 Aug 02 09:09:51.310289 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 529/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:51 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:52.331831 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-f13dedac-918a-45fd-8855-b110b93909b3 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:52.332568 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-f13dedac-918a-45fd-8855-b110b93909b3 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:52.335119 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:52.342401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f13dedac-918a-45fd-8855-b110b93909b3 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.342919 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f13dedac-918a-45fd-8855-b110b93909b3 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.343709 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f13dedac-918a-45fd-8855-b110b93909b3 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.344180 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-f13dedac-918a-45fd-8855-b110b93909b3 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.490040 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-f13dedac-918a-45fd-8855-b110b93909b3 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:52.497881 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-f13dedac-918a-45fd-8855-b110b93909b3 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1464 microversion: 2.1 time: 0.170328 Aug 02 09:09:52.498453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 531/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:52 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:52.543222 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-fcc49839-db8e-40de-bfcf-25697f78ca56 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:52.543736 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fcc49839-db8e-40de-bfcf-25697f78ca56 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:52.550362 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fcc49839-db8e-40de-bfcf-25697f78ca56 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.550812 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fcc49839-db8e-40de-bfcf-25697f78ca56 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.551588 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fcc49839-db8e-40de-bfcf-25697f78ca56 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.552021 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-fcc49839-db8e-40de-bfcf-25697f78ca56 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.578740 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-fcc49839-db8e-40de-bfcf-25697f78ca56 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Going to try to terminate instance {{(pid=117773) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:09:52.674338 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-fcc49839-db8e-40de-bfcf-25697f78ca56 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 204 len: 0 microversion: 2.1 time: 0.134425 Aug 02 09:09:52.674836 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 530/1061] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:09:52 2022] DELETE /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:09:52.683080 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-77b40dd6-9df6-4a68-9ef3-b8a31aa56716 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:52.683697 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-77b40dd6-9df6-4a68-9ef3-b8a31aa56716 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:52.689816 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-77b40dd6-9df6-4a68-9ef3-b8a31aa56716 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.690277 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-77b40dd6-9df6-4a68-9ef3-b8a31aa56716 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.691053 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-77b40dd6-9df6-4a68-9ef3-b8a31aa56716 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.691493 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-77b40dd6-9df6-4a68-9ef3-b8a31aa56716 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.827084 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-77b40dd6-9df6-4a68-9ef3-b8a31aa56716 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:52.834714 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-77b40dd6-9df6-4a68-9ef3-b8a31aa56716 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1470 microversion: 2.1 time: 0.155511 Aug 02 09:09:52.835290 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 532/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:52 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:53.855945 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ec04377e-be6b-4b73-a6f0-2ca84674de23 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:53.856663 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ec04377e-be6b-4b73-a6f0-2ca84674de23 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:53.863833 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ec04377e-be6b-4b73-a6f0-2ca84674de23 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:53.864427 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ec04377e-be6b-4b73-a6f0-2ca84674de23 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:53.865785 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ec04377e-be6b-4b73-a6f0-2ca84674de23 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:53.866217 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ec04377e-be6b-4b73-a6f0-2ca84674de23 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:53.999731 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ec04377e-be6b-4b73-a6f0-2ca84674de23 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:54.009188 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ec04377e-be6b-4b73-a6f0-2ca84674de23 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1470 microversion: 2.1 time: 0.156925 Aug 02 09:09:54.009742 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 531/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:53 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:55.030233 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-bbfbc605-96a2-4473-a1c9-dad156e8321c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:55.030873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-bbfbc605-96a2-4473-a1c9-dad156e8321c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:55.038062 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bbfbc605-96a2-4473-a1c9-dad156e8321c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.038511 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bbfbc605-96a2-4473-a1c9-dad156e8321c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.039282 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bbfbc605-96a2-4473-a1c9-dad156e8321c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.039719 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-bbfbc605-96a2-4473-a1c9-dad156e8321c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.186770 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-bbfbc605-96a2-4473-a1c9-dad156e8321c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6a21ca5074f1598cd417d80c96feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0a70b5f594643ba70d6b7829e3124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:55.194438 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-bbfbc605-96a2-4473-a1c9-dad156e8321c tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 200 len: 1470 microversion: 2.1 time: 0.168015 Aug 02 09:09:55.195271 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 533/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:55 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:55.430307 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-f644253e-84f6-4778-8c03-3862d2662286 req-5276e232-7987-4f76-a99c-802e42994e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9336b69-035d-47f4-9145-e31d9dea37c1", "name": "network-vif-deleted", "tag": "71ab9f51-9fb6-4b56-bf63-900f12c45aa7"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:55.440289 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-f644253e-84f6-4778-8c03-3862d2662286 req-5276e232-7987-4f76-a99c-802e42994e9d service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.440650 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-f644253e-84f6-4778-8c03-3862d2662286 req-5276e232-7987-4f76-a99c-802e42994e9d service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.453274 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-f644253e-84f6-4778-8c03-3862d2662286 req-5276e232-7987-4f76-a99c-802e42994e9d service nova] Creating event network-vif-deleted:71ab9f51-9fb6-4b56-bf63-900f12c45aa7 for instance e9336b69-035d-47f4-9145-e31d9dea37c1 on hv-cinder-78729 Aug 02 09:09:55.458449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-f644253e-84f6-4778-8c03-3862d2662286 req-5276e232-7987-4f76-a99c-802e42994e9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094931 Aug 02 09:09:55.459934 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 532/1065] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:56.218366 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:56.218926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] [instance: e9336b69-035d-47f4-9145-e31d9dea37c1] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:56.225955 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:56.226404 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:56.227172 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:56.227612 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:56.241618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] HTTP exception thrown: Instance e9336b69-035d-47f4-9145-e31d9dea37c1 could not be found. Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Request method failure captured: Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 HTTP/1.1 Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OnSeJtIDyvwYFmZQ7JGIQFN3bQlvD4lAA_QCR5GuiAPS71PBFs60BKB9Jp8jVYlIue7nGvJgQmJLUStDG9_14cevOUbwry1Sawg_Fu46Z7iXi9k54pZfX_WuBSJhTX-lPZ8ho8J_0Wo7eZ19rmGRVH5_eyzr3F0iDH5Pv4vzpQP5KQ Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 2ed0a70b5f594643ba70d6b7829e3124 Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-VolumesNegativeTest-1262794623 Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:09:56.243401 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ed0a70b5f594643ba70d6b7829e3124", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ed0a70b5f594643ba70d6b7829e3124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ed0a70b5f594643ba70d6b7829e3124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ed0a70b5f594643ba70d6b7829e3124"}]}] Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-VolumesNegativeTest-1262794623 Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 2ed0a70b5f594643ba70d6b7829e3124 Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-VolumesNegativeTest-1262794623 Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-VolumesNegativeTest-1262794623-project Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 9de6a21ca5074f1598cd417d80c96feb Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-VolumesNegativeTest-1262794623-project Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance e9336b69-035d-47f4-9145-e31d9dea37c1 could not be found. Aug 02 09:09:56.245165 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'e9336b69-035d-47f4-9145-e31d9dea37c1'} Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9336b69-035d-47f4-9145-e31d9dea37c1 could not be found. Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:09:56.246378 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9336b69-035d-47f4-9145-e31d9dea37c1 could not be found. Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9336b69-035d-47f4-9145-e31d9dea37c1 could not be found. Aug 02 09:09:56.248008 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:09:56.249584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] Returning 404 to user: Instance e9336b69-035d-47f4-9145-e31d9dea37c1 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:09:56.249584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2e66717e-d1c2-4a97-b611-d830ffc4f812 tempest-VolumesNegativeTest-1262794623 tempest-VolumesNegativeTest-1262794623-project] 10.222.0.17 "GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1" status: 404 len: 111 microversion: 2.1 time: 0.030555 Aug 02 09:09:56.249584 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 534/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:56 2022] GET /compute/v2.1/servers/e9336b69-035d-47f4-9145-e31d9dea37c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:19.109851 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:19.110730 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:19.114900 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e7deabfc-313d-4032-bb75-c43698258c46 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-198109230"}} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:19.115517 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e7deabfc-313d-4032-bb75-c43698258c46 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:19.123168 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e7deabfc-313d-4032-bb75-c43698258c46 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:19.123617 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e7deabfc-313d-4032-bb75-c43698258c46 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:19.124421 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e7deabfc-313d-4032-bb75-c43698258c46 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:19.124857 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e7deabfc-313d-4032-bb75-c43698258c46 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:19.255168 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.network.security_group_api [None req-e7deabfc-313d-4032-bb75-c43698258c46 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Removing security group 36b9d584-4982-443b-a805-9de8b5246ab7 from port 31650346-e504-4a70-a71d-069e0ce03778 Aug 02 09:10:19.801357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e7deabfc-313d-4032-bb75-c43698258c46 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "POST /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/action" status: 202 len: 0 microversion: 2.1 time: 0.693143 Aug 02 09:10:19.802040 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 533/1067] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 2 09:10:19 2022] POST /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:10:19.812294 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-e4594726-2882-4860-bdd6-8abc7c80709b req-2ae510ee-41b7-4416-85e4-a6510710237e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc288d38-55ce-4311-80be-0fe2d9d8ec3b", "tag": "31650346-e504-4a70-a71d-069e0ce03778"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:19.823076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=22 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:19.823764 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=46 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:19.826088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-e4594726-2882-4860-bdd6-8abc7c80709b req-2ae510ee-41b7-4416-85e4-a6510710237e service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:19.826543 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-e4594726-2882-4860-bdd6-8abc7c80709b req-2ae510ee-41b7-4416-85e4-a6510710237e service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:19.840667 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-e4594726-2882-4860-bdd6-8abc7c80709b req-2ae510ee-41b7-4416-85e4-a6510710237e service nova] Creating event network-changed:31650346-e504-4a70-a71d-069e0ce03778 for instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b on hv-cinder-78729 Aug 02 09:10:19.846738 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-e4594726-2882-4860-bdd6-8abc7c80709b req-2ae510ee-41b7-4416-85e4-a6510710237e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039759 Aug 02 09:10:19.847709 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 535/1068] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:20.926737 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-a82391c4-3a1e-4fdf-8b4f-07a7c3ace444 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:20.927317 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-a82391c4-3a1e-4fdf-8b4f-07a7c3ace444 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:20.930622 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-8244983f-b04a-4a7e-827d-8c81e4bf6295 req-6053c838-bb29-45fd-8279-ac748faff8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc288d38-55ce-4311-80be-0fe2d9d8ec3b", "tag": "31650346-e504-4a70-a71d-069e0ce03778"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:20.934083 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a82391c4-3a1e-4fdf-8b4f-07a7c3ace444 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:20.934542 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a82391c4-3a1e-4fdf-8b4f-07a7c3ace444 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:20.935326 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a82391c4-3a1e-4fdf-8b4f-07a7c3ace444 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:20.935767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-a82391c4-3a1e-4fdf-8b4f-07a7c3ace444 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:20.940840 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-8244983f-b04a-4a7e-827d-8c81e4bf6295 req-6053c838-bb29-45fd-8279-ac748faff8a3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:20.941513 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-8244983f-b04a-4a7e-827d-8c81e4bf6295 req-6053c838-bb29-45fd-8279-ac748faff8a3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:20.954268 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-8244983f-b04a-4a7e-827d-8c81e4bf6295 req-6053c838-bb29-45fd-8279-ac748faff8a3 service nova] Creating event network-changed:31650346-e504-4a70-a71d-069e0ce03778 for instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b on hv-cinder-78729 Aug 02 09:10:20.959448 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-8244983f-b04a-4a7e-827d-8c81e4bf6295 req-6053c838-bb29-45fd-8279-ac748faff8a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040580 Aug 02 09:10:20.960549 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 536/1069] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:10:21.018496 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-a82391c4-3a1e-4fdf-8b4f-07a7c3ace444 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lazy-loading 'services' on Instance uuid cc288d38-55ce-4311-80be-0fe2d9d8ec3b {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:21.099684 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-a82391c4-3a1e-4fdf-8b4f-07a7c3ace444 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments/6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25" status: 202 len: 0 microversion: 2.1 time: 0.187546 Aug 02 09:10:21.100823 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 534/1070] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 09:10:20 2022] DELETE /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments/6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:10:21.110757 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-581c5495-53ef-4d86-99e0-ea6d2bbe1000 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:21.113058 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-581c5495-53ef-4d86-99e0-ea6d2bbe1000 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:21.120202 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-581c5495-53ef-4d86-99e0-ea6d2bbe1000 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:21.120657 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-581c5495-53ef-4d86-99e0-ea6d2bbe1000 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:21.121445 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-581c5495-53ef-4d86-99e0-ea6d2bbe1000 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:21.122331 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-581c5495-53ef-4d86-99e0-ea6d2bbe1000 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:21.151963 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-581c5495-53ef-4d86-99e0-ea6d2bbe1000 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Aug 02 09:10:21.153069 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 537/1071] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:10:21 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:22.166614 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-610afe9b-41b9-40c4-afd9-914325abd035 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:22.169068 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-610afe9b-41b9-40c4-afd9-914325abd035 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:22.175425 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-610afe9b-41b9-40c4-afd9-914325abd035 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:22.175879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-610afe9b-41b9-40c4-afd9-914325abd035 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:22.176694 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-610afe9b-41b9-40c4-afd9-914325abd035 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:22.177138 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-610afe9b-41b9-40c4-afd9-914325abd035 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:22.205796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-610afe9b-41b9-40c4-afd9-914325abd035 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044479 Aug 02 09:10:22.206351 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 535/1072] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 2 09:10:22 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:10:22.216856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:22.217551 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:22.224149 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:22.224623 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:22.225428 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:22.225867 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:22.300546 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] HTTP exception thrown: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b is not attached to volume 6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25 Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Request method failure captured: Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: DELETE /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments/6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25 HTTP/1.1 Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OkJHZ9ARnFfQk0GMJCkxzFq5gOplSYkA_xbESqTE9x114f-ulxSZDmO5474kQ_bOQdV4EeOlCMgkuOpsIY0uGKepuaErgLMKsb7UwiU1sONkfaonUEtuVilG07OQqwM82WxCf6MTzfylEYTxnQz0JeVdQV1nw58DWAMi_UizVW-1tY Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 4e302e615c17471fa0c5638c2bc08b8c Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-TestMinimumBasicScenario-1636934106 Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:10:22.319749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e302e615c17471fa0c5638c2bc08b8c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e302e615c17471fa0c5638c2bc08b8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e302e615c17471fa0c5638c2bc08b8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e302e615c17471fa0c5638c2bc08b8c"}]}] Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-TestMinimumBasicScenario-1636934106 Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 4e302e615c17471fa0c5638c2bc08b8c Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1636934106 Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-TestMinimumBasicScenario-1636934106-project Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 3639081f2d814af4bd963399a7a63312 Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-TestMinimumBasicScenario-1636934106-project Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:10:22.321536 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b is not attached to volume 6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25 Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'server_id': 'cc288d38-55ce-4311-80be-0fe2d9d8ec3b', 'id': '6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25'} Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25. Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:22.322509 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b is not attached to volume 6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25 Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b is not attached to volume 6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25 Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:22.324193 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Returning 404 to user: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b is not attached to volume 6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25 {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:22.325393 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1fe60330-ea63-4586-94dd-c0078bd4bf14 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments/6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25" status: 404 len: 154 microversion: 2.1 time: 0.108423 Aug 02 09:10:22.325393 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 538/1073] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 2 09:10:22 2022] DELETE /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b/os-volume_attachments/6d5960eb-c60e-4f1e-a5b6-fad1a47d1e25 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:23.460477 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f72affad-8604-45c9-ab8c-e77b043c25ef tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:23.461003 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f72affad-8604-45c9-ab8c-e77b043c25ef tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:23.467031 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f72affad-8604-45c9-ab8c-e77b043c25ef tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:23.467482 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f72affad-8604-45c9-ab8c-e77b043c25ef tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:23.468310 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f72affad-8604-45c9-ab8c-e77b043c25ef tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:23.468752 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-f72affad-8604-45c9-ab8c-e77b043c25ef tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:23.494213 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f72affad-8604-45c9-ab8c-e77b043c25ef tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Going to try to terminate instance {{(pid=117773) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:10:23.569245 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f72affad-8604-45c9-ab8c-e77b043c25ef tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 204 len: 0 microversion: 2.1 time: 0.112890 Aug 02 09:10:23.570137 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 536/1074] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:10:23 2022] DELETE /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:10:23.578837 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-baca4837-c520-44cd-8393-a26fa641cb99 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:23.579450 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-baca4837-c520-44cd-8393-a26fa641cb99 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:23.586103 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-baca4837-c520-44cd-8393-a26fa641cb99 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:23.586550 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-baca4837-c520-44cd-8393-a26fa641cb99 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:23.587340 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-baca4837-c520-44cd-8393-a26fa641cb99 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:23.587755 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-baca4837-c520-44cd-8393-a26fa641cb99 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:23.719611 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-baca4837-c520-44cd-8393-a26fa641cb99 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:23.727192 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-baca4837-c520-44cd-8393-a26fa641cb99 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1551 microversion: 2.1 time: 0.152372 Aug 02 09:10:23.727747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 539/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:23 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:24.749969 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-112d1ea0-211b-4e6f-8855-81c34c346270 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:24.750675 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-112d1ea0-211b-4e6f-8855-81c34c346270 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:24.757367 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-112d1ea0-211b-4e6f-8855-81c34c346270 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:24.757819 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-112d1ea0-211b-4e6f-8855-81c34c346270 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:24.758620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-112d1ea0-211b-4e6f-8855-81c34c346270 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:24.759059 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-112d1ea0-211b-4e6f-8855-81c34c346270 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:24.896575 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-112d1ea0-211b-4e6f-8855-81c34c346270 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:24.903964 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-112d1ea0-211b-4e6f-8855-81c34c346270 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1551 microversion: 2.1 time: 0.158319 Aug 02 09:10:24.904563 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 537/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:24 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:25.925643 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0e02ce72-c46b-4f13-965f-ccdaa188f370 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:25.926253 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0e02ce72-c46b-4f13-965f-ccdaa188f370 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:25.932869 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e02ce72-c46b-4f13-965f-ccdaa188f370 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:25.933314 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e02ce72-c46b-4f13-965f-ccdaa188f370 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:25.934083 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e02ce72-c46b-4f13-965f-ccdaa188f370 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:25.934529 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0e02ce72-c46b-4f13-965f-ccdaa188f370 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:26.068312 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-0e02ce72-c46b-4f13-965f-ccdaa188f370 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3639081f2d814af4bd963399a7a63312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e302e615c17471fa0c5638c2bc08b8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:26.076219 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0e02ce72-c46b-4f13-965f-ccdaa188f370 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 200 len: 1551 microversion: 2.1 time: 0.154423 Aug 02 09:10:26.076792 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 540/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:25 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:26.511071 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-119f2fd1-f035-4366-965b-68c3d3570a66 req-ca213c45-d7da-4fd4-9f70-ee61ff057ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc288d38-55ce-4311-80be-0fe2d9d8ec3b", "name": "network-vif-deleted", "tag": "31650346-e504-4a70-a71d-069e0ce03778"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:26.521116 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-119f2fd1-f035-4366-965b-68c3d3570a66 req-ca213c45-d7da-4fd4-9f70-ee61ff057ea3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:26.521557 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-119f2fd1-f035-4366-965b-68c3d3570a66 req-ca213c45-d7da-4fd4-9f70-ee61ff057ea3 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:26.533278 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-119f2fd1-f035-4366-965b-68c3d3570a66 req-ca213c45-d7da-4fd4-9f70-ee61ff057ea3 service nova] Creating event network-vif-deleted:31650346-e504-4a70-a71d-069e0ce03778 for instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b on hv-cinder-78729 Aug 02 09:10:26.538256 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-119f2fd1-f035-4366-965b-68c3d3570a66 req-ca213c45-d7da-4fd4-9f70-ee61ff057ea3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031461 Aug 02 09:10:26.538842 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 538/1078] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:27.099526 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:27.100259 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] [instance: cc288d38-55ce-4311-80be-0fe2d9d8ec3b] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:27.106793 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:27.107248 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:27.108024 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:27.108495 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:27.122542 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] HTTP exception thrown: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b could not be found. Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Request method failure captured: Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b HTTP/1.1 Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6OkJHZ9ARnFfQk0GMJCkxzFq5gOplSYkA_xbESqTE9x114f-ulxSZDmO5474kQ_bOQdV4EeOlCMgkuOpsIY0uGKepuaErgLMKsb7UwiU1sONkfaonUEtuVilG07OQqwM82WxCf6MTzfylEYTxnQz0JeVdQV1nw58DWAMi_UizVW-1tY Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 4e302e615c17471fa0c5638c2bc08b8c Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-TestMinimumBasicScenario-1636934106 Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:10:27.124056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4e302e615c17471fa0c5638c2bc08b8c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4e302e615c17471fa0c5638c2bc08b8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e302e615c17471fa0c5638c2bc08b8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4e302e615c17471fa0c5638c2bc08b8c"}]}] Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-TestMinimumBasicScenario-1636934106 Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 4e302e615c17471fa0c5638c2bc08b8c Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1636934106 Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-TestMinimumBasicScenario-1636934106-project Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: 3639081f2d814af4bd963399a7a63312 Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-TestMinimumBasicScenario-1636934106-project Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b could not be found. Aug 02 09:10:27.125687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'cc288d38-55ce-4311-80be-0fe2d9d8ec3b'} Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b could not be found. Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:27.126636 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b could not be found. Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b could not be found. Aug 02 09:10:27.128243 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:10:27.129696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Returning 404 to user: Instance cc288d38-55ce-4311-80be-0fe2d9d8ec3b could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:27.129696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d7b1b809-33c9-48d0-9175-e6d6878f896f tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b" status: 404 len: 111 microversion: 2.1 time: 0.031729 Aug 02 09:10:27.129696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 541/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:27 2022] GET /compute/v2.1/servers/cc288d38-55ce-4311-80be-0fe2d9d8ec3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:27.134807 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-898def1b-017c-4615-968d-f75e0f08a550 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] Calling method '.version_select at 0x7f13fad4b670>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:27.153587 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-898def1b-017c-4615-968d-f75e0f08a550 tempest-TestMinimumBasicScenario-1636934106 tempest-TestMinimumBasicScenario-1636934106-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-656764179" status: 202 len: 0 microversion: 2.1 time: 0.022965 Aug 02 09:10:27.154141 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 539/1080] 10.222.0.17 () {58 vars in 1269 bytes} [Tue Aug 2 09:10:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-656764179 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:11:49.897877 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=14 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:49.899012 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=30 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:49.903567 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1290304487", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2022130069", "security_groups": [{"name": "tempest-secgroup-smoke-1261723041"}], "block_device_mapping_v2": [{"uuid": "fce18a34-b3fc-4945-9510-799e0195a3e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e340dc33-11ff-4604-ba77-133c90e12728"}]}} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:50.041562 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.network.neutron [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] validate_networks() for [('e340dc33-11ff-4604-ba77-133c90e12728', None, None, None, None, None)] {{(pid=117772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:11:50.506628 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Flavor limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:11:50.507048 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Image limits 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:11:50.507519 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Flavor pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:11:50.507924 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Image pref 0:0:0 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:11:50.508390 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.virt.hardware [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:11:50.518611 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.519055 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.519858 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.520322 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.540642 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Getting quotas for project 4b7960c66a61441faa18ef4ba42f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:50.545395 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.quota [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Getting quotas for user e469194b140942bf929001c7e12a0933 and project 4b7960c66a61441faa18ef4ba42f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=117772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:50.618717 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Going to run 1 instances... {{(pid=117772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:11:50.621085 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fce18a34-b3fc-4945-9510-799e0195a3e1',volume_size=None,volume_type=None)] {{(pid=117772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:11:50.795155 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [4092690d-b9d9-4314-b63e-b5dd1e654591] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 09:11:51.804155 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [4092690d-b9d9-4314-b63e-b5dd1e654591] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 45944. Aug 02 09:11:51.813618 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-aceac25d-cb45-4fd0-8c02-ed45db9da0c9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.913145 Aug 02 09:11:51.815099 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 542/1081] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 2 09:11:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:11:51.823877 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:51.825089 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:51.831368 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-f31af881-d125-43dd-869a-c772fe24449f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:51.832103 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-f31af881-d125-43dd-869a-c772fe24449f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:51.898061 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-f31af881-d125-43dd-869a-c772fe24449f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.905392 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-f31af881-d125-43dd-869a-c772fe24449f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1095 microversion: 2.1 time: 0.083985 Aug 02 09:11:51.906045 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 540/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:51 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:52.926515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-8de54b39-0a20-4289-a266-31f93af3f740 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.927270 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-8de54b39-0a20-4289-a266-31f93af3f740 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.993964 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-8de54b39-0a20-4289-a266-31f93af3f740 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:53.007388 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-8de54b39-0a20-4289-a266-31f93af3f740 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1095 microversion: 2.1 time: 0.085023 Aug 02 09:11:53.008432 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 543/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:52 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:54.040356 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-be1669fd-9c6a-46c2-9031-ec1d1ca9f18d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:54.041187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-be1669fd-9c6a-46c2-9031-ec1d1ca9f18d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:54.110801 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-be1669fd-9c6a-46c2-9031-ec1d1ca9f18d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.122997 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-be1669fd-9c6a-46c2-9031-ec1d1ca9f18d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1095 microversion: 2.1 time: 0.086566 Aug 02 09:11:54.124484 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 541/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:54 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:55.158583 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7c5a8e50-58de-4e19-b3a1-5b09df6032a9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:55.159270 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7c5a8e50-58de-4e19-b3a1-5b09df6032a9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:55.220277 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7c5a8e50-58de-4e19-b3a1-5b09df6032a9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.227598 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7c5a8e50-58de-4e19-b3a1-5b09df6032a9 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1095 microversion: 2.1 time: 0.076030 Aug 02 09:11:55.228196 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 544/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:55 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:56.254462 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-e48c0d8d-7ac1-4ae5-a102-a66c94c4f7d3 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:56.255492 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-e48c0d8d-7ac1-4ae5-a102-a66c94c4f7d3 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:56.267086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e48c0d8d-7ac1-4ae5-a102-a66c94c4f7d3 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.267907 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e48c0d8d-7ac1-4ae5-a102-a66c94c4f7d3 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.269419 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e48c0d8d-7ac1-4ae5-a102-a66c94c4f7d3 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.270148 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-e48c0d8d-7ac1-4ae5-a102-a66c94c4f7d3 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.342127 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-e48c0d8d-7ac1-4ae5-a102-a66c94c4f7d3 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:56.349841 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-e48c0d8d-7ac1-4ae5-a102-a66c94c4f7d3 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1145 microversion: 2.1 time: 0.103358 Aug 02 09:11:56.350741 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 542/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:56 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:57.383279 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-2e020b96-d0bf-47fa-8661-1e2f073662fc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:57.384616 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-2e020b96-d0bf-47fa-8661-1e2f073662fc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:57.397456 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2e020b96-d0bf-47fa-8661-1e2f073662fc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.397899 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2e020b96-d0bf-47fa-8661-1e2f073662fc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.398675 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2e020b96-d0bf-47fa-8661-1e2f073662fc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.399114 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-2e020b96-d0bf-47fa-8661-1e2f073662fc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.465047 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-2e020b96-d0bf-47fa-8661-1e2f073662fc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.473086 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-2e020b96-d0bf-47fa-8661-1e2f073662fc tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1211 microversion: 2.1 time: 0.094876 Aug 02 09:11:57.473598 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 545/1087] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:57 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:58.494290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-acb98450-ca60-435c-a09e-28de6953d9f8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:58.495142 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-acb98450-ca60-435c-a09e-28de6953d9f8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:58.502333 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-acb98450-ca60-435c-a09e-28de6953d9f8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.503064 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-acb98450-ca60-435c-a09e-28de6953d9f8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.504041 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-acb98450-ca60-435c-a09e-28de6953d9f8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.504645 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-acb98450-ca60-435c-a09e-28de6953d9f8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.692907 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-65c4de7e-5c3a-468a-a11e-db841f3c3955 req-c4ffea1c-f5b1-4a90-883d-d103d640ed41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5390aafc-4d3a-4bac-a739-67f0cc188c01", "tag": "c6c6019f-bb09-4fab-b332-e09e03764ee8"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:58.705982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-65c4de7e-5c3a-468a-a11e-db841f3c3955 req-c4ffea1c-f5b1-4a90-883d-d103d640ed41 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.706423 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-65c4de7e-5c3a-468a-a11e-db841f3c3955 req-c4ffea1c-f5b1-4a90-883d-d103d640ed41 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.718775 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-65c4de7e-5c3a-468a-a11e-db841f3c3955 req-c4ffea1c-f5b1-4a90-883d-d103d640ed41 service nova] Creating event network-changed:c6c6019f-bb09-4fab-b332-e09e03764ee8 for instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 on hv-cinder-78729 Aug 02 09:11:58.723797 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-65c4de7e-5c3a-468a-a11e-db841f3c3955 req-c4ffea1c-f5b1-4a90-883d-d103d640ed41 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034922 Aug 02 09:11:58.724769 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 546/1088] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:58.744428 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-acb98450-ca60-435c-a09e-28de6953d9f8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.752974 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-acb98450-ca60-435c-a09e-28de6953d9f8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.262899 Aug 02 09:11:58.753562 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 543/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:58 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:59.695543 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:11:59.696280 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 09:11:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:11:59.778648 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-1379cf30-1681-4698-9d4a-e38eed6a5c15 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:59.779591 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-1379cf30-1681-4698-9d4a-e38eed6a5c15 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:59.788517 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1379cf30-1681-4698-9d4a-e38eed6a5c15 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.789235 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1379cf30-1681-4698-9d4a-e38eed6a5c15 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.790558 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1379cf30-1681-4698-9d4a-e38eed6a5c15 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.791076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-1379cf30-1681-4698-9d4a-e38eed6a5c15 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.945471 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-1379cf30-1681-4698-9d4a-e38eed6a5c15 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:59.958658 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-1379cf30-1681-4698-9d4a-e38eed6a5c15 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.186833 Aug 02 09:11:59.959159 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 547/1090] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:59 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:00.980078 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-87505871-2f79-4b66-ac5c-c5455b8a9617 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:00.981081 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-87505871-2f79-4b66-ac5c-c5455b8a9617 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:00.992244 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-87505871-2f79-4b66-ac5c-c5455b8a9617 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.992880 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-87505871-2f79-4b66-ac5c-c5455b8a9617 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.994286 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-87505871-2f79-4b66-ac5c-c5455b8a9617 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.995048 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-87505871-2f79-4b66-ac5c-c5455b8a9617 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.189330 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-87505871-2f79-4b66-ac5c-c5455b8a9617 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.203180 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-87505871-2f79-4b66-ac5c-c5455b8a9617 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.226883 Aug 02 09:12:01.204189 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 544/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:00 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:02.238460 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-be7af494-3a1a-4833-aa73-9eda8adce371 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:02.239183 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-be7af494-3a1a-4833-aa73-9eda8adce371 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:02.240895 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=2 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:02.247111 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be7af494-3a1a-4833-aa73-9eda8adce371 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.247606 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be7af494-3a1a-4833-aa73-9eda8adce371 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.248522 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be7af494-3a1a-4833-aa73-9eda8adce371 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.249041 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-be7af494-3a1a-4833-aa73-9eda8adce371 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.406687 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-be7af494-3a1a-4833-aa73-9eda8adce371 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:02.423931 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-be7af494-3a1a-4833-aa73-9eda8adce371 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.189641 Aug 02 09:12:02.424721 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 548/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:02 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:03.452401 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-4aac42b8-d7b0-4ea5-9f8f-f0bb8b82f6a4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:03.453407 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-4aac42b8-d7b0-4ea5-9f8f-f0bb8b82f6a4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:03.463158 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4aac42b8-d7b0-4ea5-9f8f-f0bb8b82f6a4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.463796 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4aac42b8-d7b0-4ea5-9f8f-f0bb8b82f6a4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.464980 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4aac42b8-d7b0-4ea5-9f8f-f0bb8b82f6a4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.465607 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-4aac42b8-d7b0-4ea5-9f8f-f0bb8b82f6a4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.651257 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-4aac42b8-d7b0-4ea5-9f8f-f0bb8b82f6a4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:03.660613 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-4aac42b8-d7b0-4ea5-9f8f-f0bb8b82f6a4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.214621 Aug 02 09:12:03.661208 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 545/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:03 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:04.685394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-44a8e5b1-689e-4d3f-86ca-df0835453973 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:04.686991 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-44a8e5b1-689e-4d3f-86ca-df0835453973 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:04.697664 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-44a8e5b1-689e-4d3f-86ca-df0835453973 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.698324 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-44a8e5b1-689e-4d3f-86ca-df0835453973 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.699245 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-44a8e5b1-689e-4d3f-86ca-df0835453973 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.699696 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-44a8e5b1-689e-4d3f-86ca-df0835453973 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.903363 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-44a8e5b1-689e-4d3f-86ca-df0835453973 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:04.912452 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-44a8e5b1-689e-4d3f-86ca-df0835453973 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.233667 Aug 02 09:12:04.913226 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 549/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:04 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:05.937240 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-ee3a4734-dda7-4ccc-b555-9caeb0afe45b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:05.938256 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-ee3a4734-dda7-4ccc-b555-9caeb0afe45b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:05.940685 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell0:SELECT=4 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:05.947759 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee3a4734-dda7-4ccc-b555-9caeb0afe45b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.948232 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee3a4734-dda7-4ccc-b555-9caeb0afe45b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.949022 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee3a4734-dda7-4ccc-b555-9caeb0afe45b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.949456 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-ee3a4734-dda7-4ccc-b555-9caeb0afe45b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:06.144027 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-ee3a4734-dda7-4ccc-b555-9caeb0afe45b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:06.157620 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-ee3a4734-dda7-4ccc-b555-9caeb0afe45b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.225240 Aug 02 09:12:06.158691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 546/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:05 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:07.181606 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-dc62fa57-b905-4ebe-917e-42b987fbd91b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:07.182275 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-dc62fa57-b905-4ebe-917e-42b987fbd91b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:07.184356 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell0:SELECT=10 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:07.191275 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc62fa57-b905-4ebe-917e-42b987fbd91b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.191863 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc62fa57-b905-4ebe-917e-42b987fbd91b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.193053 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc62fa57-b905-4ebe-917e-42b987fbd91b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.193589 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-dc62fa57-b905-4ebe-917e-42b987fbd91b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.362896 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-dc62fa57-b905-4ebe-917e-42b987fbd91b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:07.370882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-dc62fa57-b905-4ebe-917e-42b987fbd91b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.195322 Aug 02 09:12:07.371458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 550/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:07 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:08.329848 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:12:08.330704 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Tue Aug 2 09:12:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:12:08.396490 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5daeca1a-bae4-4c8a-b0c2-aae950aac9b4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:08.397602 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5daeca1a-bae4-4c8a-b0c2-aae950aac9b4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:08.405908 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5daeca1a-bae4-4c8a-b0c2-aae950aac9b4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.406391 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5daeca1a-bae4-4c8a-b0c2-aae950aac9b4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.407509 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5daeca1a-bae4-4c8a-b0c2-aae950aac9b4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.408158 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5daeca1a-bae4-4c8a-b0c2-aae950aac9b4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.613449 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5daeca1a-bae4-4c8a-b0c2-aae950aac9b4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:08.626229 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5daeca1a-bae4-4c8a-b0c2-aae950aac9b4 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.237435 Aug 02 09:12:08.626813 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 547/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:08 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:09.650003 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-edf6e148-14d1-4bb8-bcf4-eb7a70b6a5ed tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:09.650811 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-edf6e148-14d1-4bb8-bcf4-eb7a70b6a5ed tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:09.658313 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-edf6e148-14d1-4bb8-bcf4-eb7a70b6a5ed tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.659098 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-edf6e148-14d1-4bb8-bcf4-eb7a70b6a5ed tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.660515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-edf6e148-14d1-4bb8-bcf4-eb7a70b6a5ed tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.661355 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-edf6e148-14d1-4bb8-bcf4-eb7a70b6a5ed tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.858603 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-edf6e148-14d1-4bb8-bcf4-eb7a70b6a5ed tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:09.867658 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-edf6e148-14d1-4bb8-bcf4-eb7a70b6a5ed tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.221816 Aug 02 09:12:09.868416 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 551/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:09 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:10.900829 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-d3058125-b448-44a7-82d7-9f51a51a783f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:10.901825 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-d3058125-b448-44a7-82d7-9f51a51a783f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:10.909283 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3058125-b448-44a7-82d7-9f51a51a783f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.909733 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3058125-b448-44a7-82d7-9f51a51a783f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.910522 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3058125-b448-44a7-82d7-9f51a51a783f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.910995 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-d3058125-b448-44a7-82d7-9f51a51a783f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:11.126090 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-d3058125-b448-44a7-82d7-9f51a51a783f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:11.139111 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-d3058125-b448-44a7-82d7-9f51a51a783f tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.242313 Aug 02 09:12:11.140631 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 548/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:10 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:11.445582 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-21c2fa1b-36aa-4fc1-9b4d-ee69e21c6037 req-9dfc465b-84be-4502-a03d-49a21f35d404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5390aafc-4d3a-4bac-a739-67f0cc188c01", "name": "network-vif-plugged", "status": "completed", "tag": "c6c6019f-bb09-4fab-b332-e09e03764ee8"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:11.462749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-21c2fa1b-36aa-4fc1-9b4d-ee69e21c6037 req-9dfc465b-84be-4502-a03d-49a21f35d404 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:11.463515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-21c2fa1b-36aa-4fc1-9b4d-ee69e21c6037 req-9dfc465b-84be-4502-a03d-49a21f35d404 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:11.484385 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-21c2fa1b-36aa-4fc1-9b4d-ee69e21c6037 req-9dfc465b-84be-4502-a03d-49a21f35d404 service nova] Creating event network-vif-plugged:c6c6019f-bb09-4fab-b332-e09e03764ee8 for instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 on hv-cinder-78729 Aug 02 09:12:11.492864 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-21c2fa1b-36aa-4fc1-9b4d-ee69e21c6037 req-9dfc465b-84be-4502-a03d-49a21f35d404 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323525 Aug 02 09:12:11.493915 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 552/1100] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:12.176807 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-6ad82ef5-2f6c-4e37-aa18-499cd3963817 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:12.177720 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-6ad82ef5-2f6c-4e37-aa18-499cd3963817 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:12.189066 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6ad82ef5-2f6c-4e37-aa18-499cd3963817 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.189516 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6ad82ef5-2f6c-4e37-aa18-499cd3963817 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.190303 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6ad82ef5-2f6c-4e37-aa18-499cd3963817 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.190748 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-6ad82ef5-2f6c-4e37-aa18-499cd3963817 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.378479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-6ad82ef5-2f6c-4e37-aa18-499cd3963817 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:12.393146 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-6ad82ef5-2f6c-4e37-aa18-499cd3963817 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.223682 Aug 02 09:12:12.394187 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 549/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:12 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:13.434118 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-69f7c856-c9af-40e5-95a5-8e1fdc5aa04e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:13.435521 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-69f7c856-c9af-40e5-95a5-8e1fdc5aa04e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:13.445631 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-69f7c856-c9af-40e5-95a5-8e1fdc5aa04e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.446252 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-69f7c856-c9af-40e5-95a5-8e1fdc5aa04e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.447222 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-69f7c856-c9af-40e5-95a5-8e1fdc5aa04e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.447774 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-69f7c856-c9af-40e5-95a5-8e1fdc5aa04e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.634922 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-69f7c856-c9af-40e5-95a5-8e1fdc5aa04e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:13.644649 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-69f7c856-c9af-40e5-95a5-8e1fdc5aa04e tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1267 microversion: 2.1 time: 0.219466 Aug 02 09:12:13.645434 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 553/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:13 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:14.679959 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5cef5d3c-300d-4895-b102-c3b65583774b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:14.681009 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5cef5d3c-300d-4895-b102-c3b65583774b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:14.691880 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5cef5d3c-300d-4895-b102-c3b65583774b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.692850 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5cef5d3c-300d-4895-b102-c3b65583774b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.694086 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5cef5d3c-300d-4895-b102-c3b65583774b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.694753 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5cef5d3c-300d-4895-b102-c3b65583774b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.899588 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5cef5d3c-300d-4895-b102-c3b65583774b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:14.908779 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5cef5d3c-300d-4895-b102-c3b65583774b tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1455 microversion: 2.1 time: 0.232662 Aug 02 09:12:14.909464 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 550/1103] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:14 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1455 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:14.934117 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-d78bb077-0294-45ef-93d3-93445e38ec2c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:14.934979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-d78bb077-0294-45ef-93d3-93445e38ec2c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:14.942647 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d78bb077-0294-45ef-93d3-93445e38ec2c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.943091 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d78bb077-0294-45ef-93d3-93445e38ec2c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.943874 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d78bb077-0294-45ef-93d3-93445e38ec2c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.944359 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-d78bb077-0294-45ef-93d3-93445e38ec2c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.145428 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-d78bb077-0294-45ef-93d3-93445e38ec2c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:15.158768 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-d78bb077-0294-45ef-93d3-93445e38ec2c tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1455 microversion: 2.1 time: 0.228245 Aug 02 09:12:15.159822 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 554/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:14 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1455 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:18.116716 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-b8d86354-9757-4f68-a857-9d34dd9a59d2 req-b1b33389-30af-429b-824d-ec417eddc8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5390aafc-4d3a-4bac-a739-67f0cc188c01", "tag": "c6c6019f-bb09-4fab-b332-e09e03764ee8"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:18.127311 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-b8d86354-9757-4f68-a857-9d34dd9a59d2 req-b1b33389-30af-429b-824d-ec417eddc8e1 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.127815 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-b8d86354-9757-4f68-a857-9d34dd9a59d2 req-b1b33389-30af-429b-824d-ec417eddc8e1 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.141973 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-b8d86354-9757-4f68-a857-9d34dd9a59d2 req-b1b33389-30af-429b-824d-ec417eddc8e1 service nova] Creating event network-changed:c6c6019f-bb09-4fab-b332-e09e03764ee8 for instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 on hv-cinder-78729 Aug 02 09:12:18.147967 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-b8d86354-9757-4f68-a857-9d34dd9a59d2 req-b1b33389-30af-429b-824d-ec417eddc8e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035205 Aug 02 09:12:18.148702 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 551/1105] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:21.745223 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR oslo.messaging._drivers.impl_rabbit [-] [45904b08-e2e5-4348-8817-6328f43f5ec3] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 02 09:14:21.746090 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_api:SELECT=28 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:21.746873 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-0d48f4fa-1496-4d5e-890d-56956c4803c6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.747629 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0d48f4fa-1496-4d5e-890d-56956c4803c6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.747955 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG dbcounter [-] [117773] Writing DB stats nova_cell1:SELECT=56 {{(pid=117773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:21.751176 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5e7d0eba-515c-46ed-976e-eeae92753386] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 09:14:21.751780 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:21.752852 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG dbcounter [-] [117772] Writing DB stats nova_cell1:SELECT=54 {{(pid=117772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:21.754949 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [req-dc34f0a1-2f4d-4d0b-8abf-6487a7777492 req-c34a3743-5bfd-415c-b900-b930ac182874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5390aafc-4d3a-4bac-a739-67f0cc188c01", "tag": "c6c6019f-bb09-4fab-b332-e09e03764ee8"}]} {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:21.759515 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d48f4fa-1496-4d5e-890d-56956c4803c6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.760839 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d48f4fa-1496-4d5e-890d-56956c4803c6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.761730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d48f4fa-1496-4d5e-890d-56956c4803c6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.762438 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-0d48f4fa-1496-4d5e-890d-56956c4803c6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.771162 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-dc34f0a1-2f4d-4d0b-8abf-6487a7777492 req-c34a3743-5bfd-415c-b900-b930ac182874 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.772180 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [req-dc34f0a1-2f4d-4d0b-8abf-6487a7777492 req-c34a3743-5bfd-415c-b900-b930ac182874 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.793548 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-0d48f4fa-1496-4d5e-890d-56956c4803c6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Going to try to terminate instance {{(pid=117772) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:14:21.794619 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.compute.server_external_events [req-dc34f0a1-2f4d-4d0b-8abf-6487a7777492 req-c34a3743-5bfd-415c-b900-b930ac182874 service nova] Creating event network-changed:c6c6019f-bb09-4fab-b332-e09e03764ee8 for instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 on hv-cinder-78729 Aug 02 09:14:21.800331 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [req-dc34f0a1-2f4d-4d0b-8abf-6487a7777492 req-c34a3743-5bfd-415c-b900-b930ac182874 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057943 Aug 02 09:14:21.801214 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 552/1106] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:21.946326 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-0d48f4fa-1496-4d5e-890d-56956c4803c6 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 204 len: 0 microversion: 2.1 time: 0.211183 Aug 02 09:14:21.947744 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 555/1107] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:14:21 2022] DELETE /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:14:21.960181 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-8fd3894d-0a48-4394-bc7a-9664a074c279 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.962304 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-8fd3894d-0a48-4394-bc7a-9664a074c279 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.975784 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8fd3894d-0a48-4394-bc7a-9664a074c279 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.977167 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8fd3894d-0a48-4394-bc7a-9664a074c279 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.979197 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8fd3894d-0a48-4394-bc7a-9664a074c279 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.980108 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-8fd3894d-0a48-4394-bc7a-9664a074c279 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.280968 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-8fd3894d-0a48-4394-bc7a-9664a074c279 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:22.290172 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-8fd3894d-0a48-4394-bc7a-9664a074c279 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1580 microversion: 2.1 time: 0.337435 Aug 02 09:14:22.290951 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 553/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:21 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1580 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:23.330276 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-7f22c073-855a-4617-9c70-bb2a8a6a38d5 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:23.331466 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-7f22c073-855a-4617-9c70-bb2a8a6a38d5 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:23.344394 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f22c073-855a-4617-9c70-bb2a8a6a38d5 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.344847 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f22c073-855a-4617-9c70-bb2a8a6a38d5 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.345639 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f22c073-855a-4617-9c70-bb2a8a6a38d5 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.346080 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-7f22c073-855a-4617-9c70-bb2a8a6a38d5 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.380979 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] [5e7d0eba-515c-46ed-976e-eeae92753386] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 46082. Aug 02 09:14:23.599882 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-7f22c073-855a-4617-9c70-bb2a8a6a38d5 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:23.612817 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-7f22c073-855a-4617-9c70-bb2a8a6a38d5 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1580 microversion: 2.1 time: 0.290292 Aug 02 09:14:23.613843 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 556/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:23 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1580 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:24.643832 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-59f11e22-2d9c-42bf-ba98-2a2456798349 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:24.644688 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-59f11e22-2d9c-42bf-ba98-2a2456798349 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:24.654280 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59f11e22-2d9c-42bf-ba98-2a2456798349 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.654736 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59f11e22-2d9c-42bf-ba98-2a2456798349 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.655561 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59f11e22-2d9c-42bf-ba98-2a2456798349 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.656002 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-59f11e22-2d9c-42bf-ba98-2a2456798349 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.674532 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO oslo.messaging._drivers.impl_rabbit [-] [45904b08-e2e5-4348-8817-6328f43f5ec3] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 46088. Aug 02 09:14:24.748712 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-59f11e22-2d9c-42bf-ba98-2a2456798349 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.760871 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-59f11e22-2d9c-42bf-ba98-2a2456798349 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1393 microversion: 2.1 time: 0.121126 Aug 02 09:14:24.761804 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 554/1110] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:24 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1393 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:24.778588 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-6a4d49fd-9e4e-4fa7-a17c-6020c4679f4f req-7fe592b7-1e8f-47b9-8ba6-85023150c1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5390aafc-4d3a-4bac-a739-67f0cc188c01", "name": "network-vif-deleted", "tag": "c6c6019f-bb09-4fab-b332-e09e03764ee8"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:24.791990 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6a4d49fd-9e4e-4fa7-a17c-6020c4679f4f req-7fe592b7-1e8f-47b9-8ba6-85023150c1ab service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.792735 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6a4d49fd-9e4e-4fa7-a17c-6020c4679f4f req-7fe592b7-1e8f-47b9-8ba6-85023150c1ab service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.808756 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-6a4d49fd-9e4e-4fa7-a17c-6020c4679f4f req-7fe592b7-1e8f-47b9-8ba6-85023150c1ab service nova] Creating event network-vif-deleted:c6c6019f-bb09-4fab-b332-e09e03764ee8 for instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 on hv-cinder-78729 Aug 02 09:14:24.814862 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-6a4d49fd-9e4e-4fa7-a17c-6020c4679f4f req-7fe592b7-1e8f-47b9-8ba6-85023150c1ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040998 Aug 02 09:14:24.816002 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 557/1111] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:25.795643 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:25.796885 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:25.809347 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.809879 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.811218 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.811795 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.854117 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.854551 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.855002 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lazy-loading 'fault' on Instance uuid 5390aafc-4d3a-4bac-a739-67f0cc188c01 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:25.925429 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:25.933735 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-5b526c81-8594-4bd7-afe2-2182a1f494be tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 200 len: 1185 microversion: 2.1 time: 0.146187 Aug 02 09:14:25.934639 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 555/1112] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:25 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 1185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:26.961894 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:26.962629 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 5390aafc-4d3a-4bac-a739-67f0cc188c01] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:26.970704 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.971158 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.971950 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.972429 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.988048 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] HTTP exception thrown: Instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 could not be found. Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Request method failure captured: Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 HTTP/1.1 Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6Oixkn59yr6wuXjkaaHtGxT_e5zjiNZVXI_m27dasm09ki80E9lbJDqu5Cr4uIW3ayGc_rQppvMbme9MBfBkPVJcO-8id5y03HmpL4ze0oyU62KTH1Sk8wU--J_zSCzjwViMLY9loO552178rhHs9vG4Volq2bs8sqrYUP9wg7Rs2dQ Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:14:26.989790 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b7960c66a61441faa18ef4ba42f5e5e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}] Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e469194b140942bf929001c7e12a0933 Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 could not be found. Aug 02 09:14:26.992028 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '5390aafc-4d3a-4bac-a739-67f0cc188c01'} Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 could not be found. Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:26.992946 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 could not be found. Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 could not be found. Aug 02 09:14:26.994458 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.995965 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Returning 404 to user: Instance 5390aafc-4d3a-4bac-a739-67f0cc188c01 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:26.995965 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-ead0f04e-ed74-4017-8f32-9febc73ddfcb tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01" status: 404 len: 111 microversion: 2.1 time: 0.033732 Aug 02 09:14:26.995965 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 558/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:26 2022] GET /compute/v2.1/servers/5390aafc-4d3a-4bac-a739-67f0cc188c01 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:14:30.586329 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-b21bd899-adf3-46c8-ac86-37c57cf1f0a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.587246 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b21bd899-adf3-46c8-ac86-37c57cf1f0a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.589102 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-6183fc83-e0ae-4ca9-a0b8-df830a4a46ce req-a7e38e88-9e45-4f48-a2cd-a6d191fc3d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28da5cb-5993-4f00-8eb8-e92df2b91327", "tag": "93c10580-c667-40a2-b8f1-70aaf1f3ed5b"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:30.598595 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b21bd899-adf3-46c8-ac86-37c57cf1f0a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.599430 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b21bd899-adf3-46c8-ac86-37c57cf1f0a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.600592 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b21bd899-adf3-46c8-ac86-37c57cf1f0a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.600999 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-b21bd899-adf3-46c8-ac86-37c57cf1f0a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.605749 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6183fc83-e0ae-4ca9-a0b8-df830a4a46ce req-a7e38e88-9e45-4f48-a2cd-a6d191fc3d3c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.607319 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-6183fc83-e0ae-4ca9-a0b8-df830a4a46ce req-a7e38e88-9e45-4f48-a2cd-a6d191fc3d3c service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.622982 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-6183fc83-e0ae-4ca9-a0b8-df830a4a46ce req-a7e38e88-9e45-4f48-a2cd-a6d191fc3d3c service nova] Creating event network-changed:93c10580-c667-40a2-b8f1-70aaf1f3ed5b for instance e28da5cb-5993-4f00-8eb8-e92df2b91327 on hv-cinder-78729 Aug 02 09:14:30.630999 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-b21bd899-adf3-46c8-ac86-37c57cf1f0a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Going to try to terminate instance {{(pid=117773) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:14:30.631884 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-6183fc83-e0ae-4ca9-a0b8-df830a4a46ce req-a7e38e88-9e45-4f48-a2cd-a6d191fc3d3c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049179 Aug 02 09:14:30.632989 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 559/1114] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:30.747691 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-b21bd899-adf3-46c8-ac86-37c57cf1f0a8 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 204 len: 0 microversion: 2.1 time: 0.166677 Aug 02 09:14:30.748499 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 556/1115] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:14:30 2022] DELETE /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:14:30.763152 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-6cdefb25-f6c2-4bbe-859d-de2dd9c04d04 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.764926 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-6cdefb25-f6c2-4bbe-859d-de2dd9c04d04 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.773856 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6cdefb25-f6c2-4bbe-859d-de2dd9c04d04 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.774416 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6cdefb25-f6c2-4bbe-859d-de2dd9c04d04 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.775516 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6cdefb25-f6c2-4bbe-859d-de2dd9c04d04 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.776024 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-6cdefb25-f6c2-4bbe-859d-de2dd9c04d04 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.021337 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.policy [None req-6cdefb25-f6c2-4bbe-859d-de2dd9c04d04 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117772) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.031223 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-6cdefb25-f6c2-4bbe-859d-de2dd9c04d04 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1580 microversion: 2.1 time: 0.276843 Aug 02 09:14:31.032006 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 560/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1580 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:32.067026 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-77b58f2a-685e-403c-bee7-a1b6601cfa0d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:32.067919 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-77b58f2a-685e-403c-bee7-a1b6601cfa0d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:32.078919 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-77b58f2a-685e-403c-bee7-a1b6601cfa0d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.079707 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-77b58f2a-685e-403c-bee7-a1b6601cfa0d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.082679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-77b58f2a-685e-403c-bee7-a1b6601cfa0d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.082679 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-77b58f2a-685e-403c-bee7-a1b6601cfa0d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.336162 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-77b58f2a-685e-403c-bee7-a1b6601cfa0d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:32.345294 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-77b58f2a-685e-403c-bee7-a1b6601cfa0d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1461 microversion: 2.1 time: 0.283086 Aug 02 09:14:32.346283 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 557/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:32 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1461 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:32.626716 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [req-cc61d51e-badc-468e-a9e2-d0a5d4cf01e4 req-37ae69b0-5f86-4861-9ff4-d0ae256a4a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28da5cb-5993-4f00-8eb8-e92df2b91327", "name": "network-vif-deleted", "tag": "93c10580-c667-40a2-b8f1-70aaf1f3ed5b"}]} {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:32.651968 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-cc61d51e-badc-468e-a9e2-d0a5d4cf01e4 req-37ae69b0-5f86-4861-9ff4-d0ae256a4a39 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.652369 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [req-cc61d51e-badc-468e-a9e2-d0a5d4cf01e4 req-37ae69b0-5f86-4861-9ff4-d0ae256a4a39 service nova] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.672641 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.compute.server_external_events [req-cc61d51e-badc-468e-a9e2-d0a5d4cf01e4 req-37ae69b0-5f86-4861-9ff4-d0ae256a4a39 service nova] Creating event network-vif-deleted:93c10580-c667-40a2-b8f1-70aaf1f3ed5b for instance e28da5cb-5993-4f00-8eb8-e92df2b91327 on hv-cinder-78729 Aug 02 09:14:32.681109 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [req-cc61d51e-badc-468e-a9e2-d0a5d4cf01e4 req-37ae69b0-5f86-4861-9ff4-d0ae256a4a39 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057723 Aug 02 09:14:32.682730 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 561/1118] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:33.382315 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:33.383397 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:33.389911 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.390360 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.391147 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.391585 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.431942 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.432738 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.433543 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.objects.instance [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lazy-loading 'fault' on Instance uuid e28da5cb-5993-4f00-8eb8-e92df2b91327 {{(pid=117773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:33.494111 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.policy [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e469194b140942bf929001c7e12a0933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7960c66a61441faa18ef4ba42f5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117773) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.502402 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-adcfae69-72e4-4600-aa16-2b9579b2d1b0 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 200 len: 1231 microversion: 2.1 time: 0.124465 Aug 02 09:14:33.503088 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 558/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:33 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 1231 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:34.530966 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.532177 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: e28da5cb-5993-4f00-8eb8-e92df2b91327] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.539812 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.540308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.541645 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.542082 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.557076 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] HTTP exception thrown: Instance e28da5cb-5993-4f00-8eb8-e92df2b91327 could not be found. Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Request method failure captured: Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 HTTP/1.1 Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6Oixkn59yr6wuXjkaaHtGxT_e5zjiNZVXI_m27dasm09ki80E9lbJDqu5Cr4uIW3ayGc_rQppvMbme9MBfBkPVJcO-8id5y03HmpL4ze0oyU62KTH1Sk8wU--J_zSCzjwViMLY9loO552178rhHs9vG4Volq2bs8sqrYUP9wg7Rs2dQ Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:14:34.558850 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b7960c66a61441faa18ef4ba42f5e5e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}] Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e469194b140942bf929001c7e12a0933 Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance e28da5cb-5993-4f00-8eb8-e92df2b91327 could not be found. Aug 02 09:14:34.562027 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': 'e28da5cb-5993-4f00-8eb8-e92df2b91327'} Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e28da5cb-5993-4f00-8eb8-e92df2b91327 could not be found. Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:34.563897 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e28da5cb-5993-4f00-8eb8-e92df2b91327 could not be found. Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e28da5cb-5993-4f00-8eb8-e92df2b91327 could not be found. Aug 02 09:14:34.567056 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:34.570433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Returning 404 to user: Instance e28da5cb-5993-4f00-8eb8-e92df2b91327 could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:34.570433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-5a5c17ad-23ea-4996-8cce-8627f781b37d tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327" status: 404 len: 111 microversion: 2.1 time: 0.038107 Aug 02 09:14:34.570433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 562/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/e28da5cb-5993-4f00-8eb8-e92df2b91327 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:14:35.096799 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.098335 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.compute.api [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117773) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.104476 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.104928 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.105704 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.106150 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG oslo_concurrency.lockutils [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.122711 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.wsgi [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] HTTP exception thrown: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Request method failure captured: Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: request: DELETE /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df HTTP/1.1 Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept: application/json Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Accept-Encoding: identity Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Connection: close Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Length: 0 Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Content-Type: application/json Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Host: 10.222.0.17 Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Openstack-System-Scope: None Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Auth-Token: gAAAAABi6Oixkn59yr6wuXjkaaHtGxT_e5zjiNZVXI_m27dasm09ki80E9lbJDqu5Cr4uIW3ayGc_rQppvMbme9MBfBkPVJcO-8id5y03HmpL4ze0oyU62KTH1Sk8wU--J_zSCzjwViMLY9loO552178rhHs9vG4Volq2bs8sqrYUP9wg7Rs2dQ Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Id: None Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Domain-Name: None Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Identity-Status: Confirmed Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Is-Admin-Project: True Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Id: default Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Domain-Name: Default Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Project-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Role: reader,member Aug 02 09:14:35.124494 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Roles: reader,member Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b7960c66a61441faa18ef4ba42f5e5e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}] Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-Tenant-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Id: default Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Domain-Name: Default Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Id: e469194b140942bf929001c7e12a0933 Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: X-User-Name: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: method: > Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: exception: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.126357 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: action_args: {'id': '0d8145a1-e135-4e3f-90c3-ce4959c7b4df'} Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:35.127497 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.129479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.131767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Returning 404 to user: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. {{(pid=117773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:35.131767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-c6585f4e-3d1e-406a-b366-860ac8165b52 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 404 len: 111 microversion: 2.1 time: 0.033086 Aug 02 09:14:35.131767 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 559/1121] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 2 09:14:35 2022] DELETE /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:14:35.138733 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '>' {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.139453 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.compute.api [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] [instance: 0d8145a1-e135-4e3f-90c3-ce4959c7b4df] Fetching instance by UUID {{(pid=117772) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.146308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.146747 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.147534 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.147976 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG oslo_concurrency.lockutils [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Lock "58122f4c-a1ac-4fa0-ab3e-697d06b208ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.166476 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.wsgi [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] HTTP exception thrown: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Request method failure captured: Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: request: GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df HTTP/1.1 Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept: application/json Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Accept-Encoding: identity Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Connection: close Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Length: 0 Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Content-Type: application/json Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Host: 10.222.0.17 Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Openstack-System-Scope: None Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Auth-Token: gAAAAABi6Oixkn59yr6wuXjkaaHtGxT_e5zjiNZVXI_m27dasm09ki80E9lbJDqu5Cr4uIW3ayGc_rQppvMbme9MBfBkPVJcO-8id5y03HmpL4ze0oyU62KTH1Sk8wU--J_zSCzjwViMLY9loO552178rhHs9vG4Volq2bs8sqrYUP9wg7Rs2dQ Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Id: None Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Domain-Name: None Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Identity-Status: Confirmed Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Is-Admin-Project: True Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Id: default Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Domain-Name: Default Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Project-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Role: reader,member Aug 02 09:14:35.168198 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Roles: reader,member Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4b7960c66a61441faa18ef4ba42f5e5e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4b7960c66a61441faa18ef4ba42f5e5e"}]}] Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Id: 4b7960c66a61441faa18ef4ba42f5e5e Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-Tenant-Name: tempest-TestVolumeBootPattern-1709568716 Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Id: default Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Domain-Name: Default Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Id: e469194b140942bf929001c7e12a0933 Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: X-User-Name: tempest-TestVolumeBootPattern-1709568716-project Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: method: > Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: exception: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.176377 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: action_args: {'id': '0d8145a1-e135-4e3f-90c3-ce4959c7b4df'} Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: {{(pid=117772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:35.178088 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. Aug 02 09:14:35.181308 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: ERROR nova.api.openstack.wsgi Aug 02 09:14:35.183413 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: DEBUG nova.api.openstack.wsgi [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Returning 404 to user: Instance 0d8145a1-e135-4e3f-90c3-ce4959c7b4df could not be found. {{(pid=117772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:35.183413 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO nova.api.openstack.requestlog [None req-143fbce7-2d11-43f5-917a-4c8a5b4c1b76 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df" status: 404 len: 111 microversion: 2.1 time: 0.035395 Aug 02 09:14:35.183413 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: [pid: 117772|app: 0|req: 563/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:35 2022] GET /compute/v2.1/servers/0d8145a1-e135-4e3f-90c3-ce4959c7b4df => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:14:36.548979 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: DEBUG nova.api.openstack.wsgi [None req-46a7a89d-b5de-4181-a3d8-e8fb69888642 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] Calling method '.version_select at 0x7f13fabc3160>' {{(pid=117773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.571888 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO nova.api.openstack.requestlog [None req-46a7a89d-b5de-4181-a3d8-e8fb69888642 tempest-TestVolumeBootPattern-1709568716 tempest-TestVolumeBootPattern-1709568716-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2022130069" status: 202 len: 0 microversion: 2.1 time: 0.026613 Aug 02 09:14:36.573352 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: [pid: 117773|app: 0|req: 560/1123] 10.222.0.17 () {58 vars in 1263 bytes} [Tue Aug 2 09:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2022130069 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:15:19.706322 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:15:19.706986 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 09:15:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:15:28.340627 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:15:28.341259 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Tue Aug 2 09:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:17:08.941764 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:17:08.942479 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Tue Aug 2 09:17:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:17:09.176932 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:17:09.177761 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 09:17:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:17:25.518752 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:17:25.519433 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 09:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:17:32.208898 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:17:32.209455 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Tue Aug 2 09:17:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:18:39.715204 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:18:39.715893 dv-cinder-787296-14-iscsi devstack@n-api.service[117772]: Tue Aug 2 09:18:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:18:48.350290 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:18:48.350782 dv-cinder-787296-14-iscsi devstack@n-api.service[117773]: Tue Aug 2 09:18:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!